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Foreword 


Barry Jacobs once memorably commented that the problem in understanding 
the role of serotonin in the brain was that it was implicated in virtually every¬ 
thing but responsible for nothing [1], Serotonin (5-HT) is definitely implicated 
in the regulation of sleep but what does it do? Once seen as a sleep-promoting 
molecule, Jacob’s own work, lucidly described in this volume, radically changed 
our view. In fact, serotonin neurons are most active during waking; their ac¬ 
tivity diminishes with sleep onset and disappears during rapid eye movement 
(REM) sleep. Serotonin, therefore, is intimately linked to the sleep-wake cycle, 
but what is its role, what mechanisms are involved and what are the implica¬ 
tions for sleep medicine and psychiatry? 

Making progress with these difficult questions requires a “translational” 
approach, which is a research paradigm where both laboratory and clinical 
neuroscience inform and guide each other with the ultimate aim of improving 
understanding and treatment of medical conditions. This volume is a superb 
example of translational research, where leading basic and clinical scientists in¬ 
tegrate molecular, neuropharmacological and systems approaches to illuminate 
the reciprocal interactions of serotonin neurons and the mechanisms involved 
in sleep and circadian regulation. 

Serotonin is an ancient chemical mediator preserved through at least 500 mil¬ 
lion years of evolution. In invertebrate animals such as mollusks and leeches, 
5-HT cells are distributed throughout the nervous system among the various 
ganglia. However, in mammals, serotonin cell bodies in the central nervous sys¬ 
tem are gathered into discrete clusters in the raphe nuclei in the midbrain [2], At 
the heart of the present enquiry, therefore, is the organization and connectiv¬ 
ity of the raphe nuclei. Once thought to be a fairly homogenous collection of 
serotonin cell bodies, new research shows that the raphe exhibits both cellular 
specialization and an exquisite topographic organization, which is reflected in 
a distinct pattern of innervation to target regions such as midbrain, thalamus, 
limbic regions and most of the cortex. These target regions in turn project back 
to the raphe, providing a rich reciprocal pharmacological regulation of 5-HT 
cell activity, involving GABA, glutamate, monoamines and neuropeptides such 
as the orexins. As Robert Vertes and Stephanie Lindley point out, the raphe is 
ideally positioned to receive inputs from many regions of the brainstem and 
limbic forebrain and cortex and then, through its extensive pattern of innerva¬ 
tion, regulate the activity of much of the distributed circuitry throughout the 
brain. In this context the effects of serotonin on sleep need to be understood in 
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terms of its neuromodulatory actions on the brainstem regions and thalamo¬ 
cortical projections involved in sleep initiation and maintenance. 

In addition to this widespread pattern of innervation, multiple serotonin re¬ 
ceptor subtypes add further complexity to the modulatory effects of serotonin 
in the central nervous system. However, modem technologies, particularly ani¬ 
mal receptor knockouts, offer great opportunities to unravel the role of 5-HT 
in sleep-wake regulation by identifying the actions of specific 5-HT receptor 
subtypes. Parallel developments in the pharmacology of receptor-selective li¬ 
gands allow congruent studies to be carried out in humans and animals. Such 
work has shown beyond doubt the prominent role of 5-HT 2 receptors in the 
regulation of slow-wave sleep, an action demonstrated clinically by the atypical 
antipsychotic drugs, many of which possess potent 5-HT 2 receptor-blocking 
properties. 

In contrast, the most consistent effect of the widely used selective serotonin 
re-uptake inhibitors (SSRIs) on sleep is a reduction in REM sleep; this may re¬ 
flect activation of 5-HT 1A receptors in the REM-generating area of the pons. It 
seems unlikely that the REM-suppressing effects of SSRIs play a primary role 
in their antidepressant and anxiolytic effects but they may underpin the benefi¬ 
cial effects of SSRI treatment in cataplexy. In the same way, the interactions of 
serotonin pathways with the suprachiasmatic nucleus and the respiratory con¬ 
trol center in the medulla offer innovative possibilities for serotonergic thera¬ 
pies in conditions such as circadian rhythm sleep disorders and sleep apnea. 

When Michel Jouvet reviewed the topic of serotonin and sleep in 1999, he 
likened the relationship to a stormy love affair that had at last reached a stage 
of reconciliation [3], The mutual understanding continues to grow and I hope 
readers of this volume will, like me, be rewarded by some truly remarkable 
insights into a fascinating and clinically important area of translational neu¬ 
roscience. 
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Preface 


Progress in the field of serotonin research and clinical use has been rapid and 
significant over the last several decades. The use of serotonin re-uptake inhibi¬ 
tors, as well as serotonin receptor agonists in the treatment of anxiety and anxi¬ 
ety-associated insomnia has been intensely explored. Due to the explosion of 
research and development in this area much of our traditional thinking and 
information on the subject has had to be revised, updated, and rewritten. 

In the last few decades the subject of sleep disturbance and how it may be 
ameliorated has also attracted intense medical and scientific interest. Converg¬ 
ing lines of research in this area have grown so rapidly that they have given 
rise to the new field of sleep medicine. These developments are reflected in the 
philosophy of the editors, and their belief that research findings in the neu¬ 
rochemistry and neuropharmacology underlying sleep/wakefulness should be 
made available to all sleep practitioners who wish to keep abreast of the latest 
developments in the expanding perspectives of this field. Due to the fact that 
no recent volume deals with the overlapping research findings on serotonin and 
its role in sleep processes, the editors felt compelled to address this deficiency. 

From the pharmaceutical industry perspective, such knowledge is instru¬ 
mental for the potential development of new psychopharmacological agents 
and therapeutic approaches. Numerous companies have a vested interest in de¬ 
veloping serotonin receptor agonists and antagonists for therapeutic applica¬ 
tions. 

The subject of this volume touches all facets of our health and well-being, 
particularly in the sleep medicine field; as such it deals with the overlapping 
interests of neuropharmacology, psychopharmacology, molecular psychiatry, 
and both experimental and clinical medical disciplines. It has been our intent 
to make the reading both enjoyable and meaningful. It is also our belief that 
the challenge of clinical medicine requires a rational approach to administer¬ 
ing pharmacological agents, and that this in turn depends on an appreciation 
of how these agents affect neurotransmitters and the nervous system generally. 
Only with such knowledge can intelligent choices be made for effective treat¬ 
ment of disease. 

The first part of the book has been divided into six sections. The introduc¬ 
tory chapter in the first section covers the changing concepts on the role of 
serotonin in the regulation of sleep and waking. The second section contains 
three chapters that address the topographic organization and projections of the 
dorsal raphe nucleus and the median raphe nucleus. 
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The two chapters in section three address the serotonin receptors, specifi¬ 
cally the localization of serotonin receptors in the mammalian CNS and their 
molecular biology. Section four deals with the electrophysiological aspects of 
serotonergic neurons and the regulation of serotonin release. The largest sec¬ 
tion in this volume is section five, which addresses the role of serotonin re¬ 
ceptors in the regulation of behavioral states. The last section contains four 
chapters. This particular section addresses the relevance of serotonin to clinical 
CNS disorders and drug action. 

The chapters have been written by experts in their respective fields. In evalu¬ 
ating potential contributions from these experts the editors’ goal was to select 
articles that were simultaneously comprehensive, highly readable, and possess¬ 
ing fully developed discussions for practical application. 

In seeking to promote an understanding of the role of serotonin across be¬ 
havioral states, it has been our goal to present some exciting new findings and 
to identify the emerging challenges that these findings imply. It is our hope that 
we have succeeded in providing a rewarding intellectual experience. 

This volume will have direct relevance to the work of pharmacists, sleep 
specialists, researchers in pharmaceutical drug development, and to physicians 
who are interested in the pharmacology of serotonin system. It will also be of 
value to advanced medical and graduate students specializing in the area of 
neuropharmacology. 

Inasmuch as we envision continuing updates of this volume, readers are 
encouraged to contact us with any thoughts and suggestions for topics to be 
included in future editions. Needless to say in the process of assembling the sig¬ 
nificant amount of material for the present compendium, there may have been 
occasional inaccuracies or omissions. We take full responsibility for those, and 
we would also appreciate having them drawn to our attention. We also welcome 
communications from our readers concerning our volume, especially any errors 
or deficiencies that may remain in this edition. Such feedback is essential to the 
continued development of this volume. 

Jaime M. Monti 
S.R. Pandi-Perumal 
Barry L. Jacobs 
David Nutt 
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Abstract 

The story of serotonin and sleep has been developing for more than 50 years, from the dis¬ 
covery in the 1950s that it had a role in brain function and in EEG synchronization. In par¬ 
allel, the areas of sleep research and neurochemistry have seen enormous developments. 
The concept of serotonin as a sleep neurotransmitter was based on the effects of lesions 
of the brainstem raphe nuclei and the effects of serotonin depleting drugs in cats. The de¬ 
scription of the firing pattern of the dorsal raphe nuclei changed this concept, initially to 
the entirely opposite view of serotonin as a waking transmitter. More recently, there has 
emerged a more complex view on the role of serotonin as a modulator of both waking and 
sleep. The effects of serotonin on sleep and waking may depend on which neurons are fir¬ 
ing, their projection site, which postsynaptic receptors are present at this site, and, not the 
least, on the functional state of the system and the organism at the particular moment. 


Introduction 

The story of serotonin and sleep has been described by Jouvet as a love story in 
four acts: The encounter, the honeymoon, the divorce, and a reconciliation [1], 
In this chapter an attempt is made to describe these different stages, or concepts, 
of the role of serotonin in sleep through a time span of more than 50 years, al¬ 
though in more prosaic terms. The idea is to show some of the data on which 
the concepts were formed, and which data changed the concepts. There has 
been a strict selection of such data, and the selection is necessarily subjective, 
depicting what has been important to the present author when working in the 
field through many of these years. Other reviews on serotonin and sleep data 
have been given earlier [2, 3], 
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The early history 

Serotonin was first demonstrated in the brain central nervous system in 1953 
[4], It did not take long before there were reports of a role of serotonin in brain 
function. Following the injection of reserpine, which depletes serotonin in the 
brain, there was a sedative effect, which paralleled a reduction of brain sero¬ 
tonin [5], In 1957 a neurotransmitter function of serotonin was suggested [6], 
However, it took many more years until serotonin was definitely recognized as 
a neuro transmitter. 


A new scientific field: Sleep research 

In the meantime, sleep became an important field of research, following the de¬ 
scription of rapid eye movement (REM) sleep [7], the new classification of sleep 
stages in humans [8], and the description of a REM sleep like stage in cats [9], 
Sleep appeared to be a double feature, with slow, synchronized brain activity, 
slow wave sleep (SWS), alternating in well-defined periods with desynchronized 
brain activity, muscle relaxation and rapid eye movements. This last stage still 
has many names: desynchronized sleep, active sleep, REM sleep, and paradoxi¬ 
cal sleep [10], the paradox being that the EEG resembled that of waking but the 
animal remained asleep. Space technology in the early 1960s made miniature 
gadgets available, suitable for recording sleep in small animals. Thus, the scene 
was set for the enormous progress in sleep research we have seen since then. 

The first descriptions of a sleep-related role of serotonin were of its func¬ 
tion as a synchronizing agent, by Bradley in 1958, reviewed in [11], Following 
intraventricular administration to cats, there was an initial arousal, followed by 
signs of behavioural drowsiness and sleep, described as hypersynchrony with 
high voltage delta waves when EEG was recorded. Serotonin does not pass the 
blood-brain barrier, and it was postulated that the synchronizing effect was 
elicited via the area postrema, since the effect disappeared following coagula¬ 
tion of this area [12], 

The use of pharmacological agents and precursor amino acid that did pass 
the barrier soon became popular ways of manipulation brain serotonin. In the 
first experiment of this kind with sleep recording, reserpine was used, and re¬ 
duced SWS was reported [13], Soon after, the drug para-chlorophenylalanine 
(pCPA), which blocks serotonin formation in the brain by blocking the enzyme 
tryptophan hydroxylase, was described [14], and was demonstrated to reduce 
sleep in cats [15], 


The concept of serotonin as a sleep transmitter 

The description of serotonin-containing neurons in the lower brainstem [16], 
and their widespread distribution [17, 18] was of great importance for the con- 
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cept of serotonin as a sleep transmitter. From the laboratory of Jouvet came 
a series of studies where serotonin-containing neurons of the raphe nuclei were 
lesioned in cats, sleep recorded and brain analyzed for serotonin [10, 19]. 


Lesions of serotonergic nuclei 

Because of their importance for the hypothesis of serotonin and sleep that was 
to follow, these experiments are referred here in some detail [19]. Electrolytic 
lesions of the raphe nuclei were performed in more than 50 cats. Total lesions 
(avoiding n. raphe pallidus where lesions were always lethal), lesions of the an¬ 
terior (rostral) group consisting of n. raphe dorsalis and n. centralis superior, 
or lesions of the posterior group consisting of n. raphe pontis, n. raphe magnus 
and n. raphe obscurus were performed. Control lesions were made in the brain 
stem midline sparing the raphe nuclei or 2-2.5 mm lateral to the midline in the 
n. raphe region, some animals were also sham operated. The animals were con¬ 
tinuously recorded (EEG, EKG, respiration and rectal temperature) from the 
day after the lesion. Following total or subtotal lesions a state of permanent 
wakefulness was observed for 3-4 days, then short periods of sleep occurred 
but never more than 5% a day. Paradoxical sleep was usually not seen. Follow¬ 
ing partial lesions the animal were awake for 2 days, regardless of which part 
was destroyed, although after rostral lesions (n. raphe dorsalis and centralis 
superior) signs of paradoxical sleep could appear without any SWS. Follow¬ 
ing sham operations or lesions less than 15%, there were no sleep reduction. 
Thus, sleep was reduced proportionally with the size of the lesion. Also, cere¬ 
bral serotonin (measured in the forebrain, diencephalon and mesencephalon) 
was reduced proportionally with the size of the lesion, and there was a negative 
relationship between brain serotonin and size of the lesion [19]. 


The pCPA studies 

The raphe lesion studies were the most important for the hypothesis on sero¬ 
tonin and sleep [10, 19]. However, in addition to the lesion studies there were 
also numerous experiments from other laboratories, aiming at modulating cen¬ 
tral nervous serotonin by pharmacological means, which supported the hypo¬ 
thesis. This was particularly the case for the pCPA studies. In a well-designed 
and well-performed experiment, Koella and coworkers [20] depleted cats, 
chronically implanted for sleep recording, of serotonin with single intraperito- 
neal pCPA injections at different doses, and recorded for up to 18 days. They 
found a dose-related reduction of sleep, starting after less than 24 h with a re¬ 
duction to 10% of control sleep following 200 mg/kg pCPA. The minimal sleep 
level occurred 48-72 h following the injection, from then on sleep returned to 
control levels after 13-16 days. Some animals received injections of the imme¬ 
diate serotonin precursor 5-hydroxytryptophan (5-HTP) 48 h after the pCPA 
injection They went to sleep within 10 min following 5-HTP, remained asleep 
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for 8 h, but 24 48 h after the 5-HTP injection the sleep-waking patterns were 
similar to that following pCPA alone. The animals were killed at different hours 
following pCPA injection and brain stem and cortical serotonin were deter¬ 
mined. The serotonin levels were reduced, initially paralleling the sleep reduc¬ 
tion, but after 3-4 days the return of sleep to control level was faster than the 
return of serotonin. 

Reports on reduced sleep following pCPA came from other laboratories as 
well. There were more studies in cats [21-23], and studies in rats [24-26] and 
monkeys [27], Jouvet [10] suggested that pCPA primarily affected SWS. This 
was supported by other studies, indicating, in addition, that the deep SWS, 
sleep dominated by delta waves, was primarily affected [20,21,23,27,28], Para¬ 
doxical sleep seemed to be affected especially with high doses of pCPA, when 
sleep was reduced to under 15% of control levels [20], 


The monoaminergic theory of sleep 

The monoaminergic theory of sleep and waking was an impressively compre¬ 
hensive hypothesis, presented in detail by Jouvet in 1972 [29], an earlier outline 
is found in [10]. According to this hypothesis, the rostral raphe neurons, n. ra¬ 
phe dorsalis and n. centralis posterior, were responsible for SWS. These nuclei, 
at the time, were postulated to project to both caudal and rostral areas of the 
brain (spinal cord, mesencephalic reticular formation, anterior hypothalamus, 
preoptic area, etc.). Release of serotonin, and binding to postsynaptic recep¬ 
tors in the projection areas, would give rise to behavioral and physiological 
criteria of SWS: sleep posture, miosis, decrease of muscle tone, and EEG syn¬ 
chronization. 

Catecholaminergic as well as cholinergic mechanisms were integrated parts 
of Jouvet’s hypothesis. Noradrenergic neurons in the anterior part of the locus 
coeruleus, and a group of catecholamine-containing neurons of the mesence¬ 
phalic tegmentum (A8) [16], as well as the dopamine-nigrostriatal system, were 
hypothesized to be important for the maintenance of tonic behavioral and EEG 
arousal. Paradoxical sleep, or REM sleep, was postulated to involve a seroto¬ 
nergic “priming” mechanism located in the raphe system, and an“executive” 
mechanism, depending upon catecholaminergic and, probably, cholinergic neu¬ 
rons in the region of the locus coeruleus [10]. The hypothesis of the “priming” 
mechanism of serotonin on paradoxical sleep was based upon findings that the 
number of paradoxical sleep episodes was closely related to brain serotonin 
content [24, 25], 

The concept of serotonin as a sleep neurotransmitter was also voiced by 
Koella [11], suggesting a mechanism of action via the area postrema, but the 
further ways of action were less clear. Supposedly there were projections from 
the area postrema to the nucleus tractus solitarius of the lower brainstem, which 
again would connect to the mesencephalic reticular formation and thus modu¬ 
late arousal. The Pisa group [30] demonstrated synchronizing EEG effects by 
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electrical low-frequency stimulation of the n. tractus solitarius, although sero¬ 
tonin was not held to be a factor in this effect [31]. 

Supporting the serotonin-sleep hypothesis was the finding of reduced sleep 
latency and/or increased sleep following administration of the amino acid sero¬ 
tonin precursor, 1-tryptophan, to humans [32, 33], Administration of 5-HTP to 
humans increased REM sleep [34], 


Increasing problems 

There were early reports that seemed to challenge the serotonin-sleep concept. 
Dement et al. [35] gave cats pCPA on a chronic basis and reported that sleep 
reappeared while brain serotonin was still very low, something Koella et al. 
[20] had also noticed. Cooling of the raphe nucleus induced sleep when it was 
performed during waking [36], and raphe lesions in rats induced hyperactiv¬ 
ity, not sleep loss [37], Precursor administration did not induce sleep in cats. 
The immediate precursor 5-HTP induced hypersynchrony and suppression of 
REM sleep [22, 38], The amino acid precursor 1-tryptophan tended to increase 
drowsiness, but not slow wave sleep, and it also reduced REM sleep. One con¬ 
clusion from the serotonin precursor studies was that these substances have a 
general deactivating effect on the waking state, but do not necessarily subserve 
a sleep inducing or sleep-maintaining function [38], In the same vein, 1-tryp¬ 
tophan given to humans in the daytime reduced sleep latency and increased 
alpha activity, but did not increase sleep [39], One finding which increasingly 
turned up, was that increasing synaptic serotonin with reuptake inhibitors in¬ 
hibits REM sleep [40], 


The concept changes - Is serotonin a waking neurotransmitter? 

Serotonergic neurons are most active in waking 

The most serious challenge to the concept of serotonin as a sleep transmit¬ 
ter was the reports of unit studies from the dorsal raphe nucleus in spontane¬ 
ously sleeping cats. It appeared that these neurons had their highest activity in 
waking, and the activity was reduced during SWS to almost cessation of firing 
during REM sleep. These findings were made possible following an important 
development of techniques, making it possible to record unit data from the 
brain in unanesthetized, and thus spontaneously sleeping animals. The first 
reports came from the USA [41, 42], from a group of researchers who had 
already demonstrated sleep effects of basal forebrain stimulation [43] and le¬ 
sions [44], The findings were confirmed by other laboratories [45^17], and the 
cells responsible for the dorsal raphe neuron firing were demonstrated to be 
serotonergic [48], Many years later, the pattern of dorsal raphe neuron firing, 
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with highest activity in waking, was also reproduced in rats [49], The unit data 
were supported by some early data on serotonin release during sleep and wak¬ 
ing. Using push-pull cannulas in encephale isole cats, a decrease in striatal and 
cortical serotonin was demonstrated when the raphe nuclei cellular activity was 
diminished [46], Later it was confirmed, using microdialysis in naturally sleep¬ 
ing animals, that serotonin release in several brain areas was highest in waking 
animals, was reduced during SWS and even more reduced during REM sleep, 
in cats [50-52] as well as in rats [53, 54], 

With the firing data the scene was set for a revision of the concept of se¬ 
rotonin as a sleep neurotransmitter. Gradually, during the 1980s, the concept 
changed. The appearance of new methods and new data was, again, instrumen¬ 
tal. However, it did not simplify the matter. 


Diverse effects on sleep of serotonin receptor subtypes complicate the story 

The description of a number of serotonergic receptors [55] and the develop¬ 
ment of more or less receptor-specific drugs gave rise to a new type of studies, 
the effects on sleep following manipulation of a single receptor type. Was it 
possible to assign the different effects of serotonin on sleep to different recep¬ 
tor types? The role of serotonergic receptors in sleep and waking is further 
described in several other chapters in this volume. Here some of the early work 
on 5-HT, and 5-HT 2 receptors are described; the complex results on the 5-HT, 
receptor in particular were instrumental in changing the views on the role of 
serotonin in sleep and waking. 

The joker in this game was the 5-HT 1A receptor. This receptor appears to be 
located both postsynaptically and presynaptically in the dorsal raphe nucleus, 
controlling the firing of the serotonergic neurons. The 5-HT 1B receptors are 
also two-faced, they are terminal receptors, controlling serotonin release, but 
are also found postsynaptically. Thus, studies of drug effects following system¬ 
ic - or local - administration of receptor manipulating drugs were bound to 
give ambiguous answers. The complex role of the 5-HT 1A receptor have been 
extensively reviewed [56], the conclusion being that 5-HT 1A receptor activa¬ 
tion may increase waking, increase SWS or increase REM sleep, depending on 
where the 5-HT 1A receptors are located within the central nervous system. A 
conclusion of equal complexity has been reached for the 5-HT 1B receptor [57], 

The sleep-waking effects of 5-HT 2 receptor stimulation and blockade seemed 
more straightforward. The receptor is located postsynaptically and has several 
subtypes. Selective agonists dose-dependently increase waking and reduce deep 
SWS (SWS-2) and REM sleep in rats [58], The 5-HT 2 receptor antagonist 
ritanserine was demonstrated to be sleep inducing in humans [59] and rats [60], 
although EEG power spectrum analysis suggested that the sleep was different 
from normal sleep [61]. In cats, ritanserine increased waking, not sleep [62], 

The 5-HT 2 receptor has been postulated to modulate activity in the thalamus 
in the direction of single spike activity (waking) [63], Later work indicates that 
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the 5-HT 7 receptor mediates thalamic depolarization [64], In any case, arousing 
functions of the 5-HT 2 and/or 5-HT 7 receptors may be the essence of the dorsal 
raphe serotonergic waking effect stressed by some authors [65, 66], supporting 
the concept of serotonin as a waking neurotransmitter. 


The serotonin reuptake inhibitors facilitate both waking and sleep 

The selective serotonin reuptake inhibitors (SSRIs) seemed to be ideal drugs to 
investigate serotonergic effects. By inhibiting serotonin reuptake from the syn¬ 
aptic cleft, they only increase serotonin when it has been released at serotoner¬ 
gic terminals, and only when the release occurs following physiological activity 
in serotonergic neurons. 

Results from many of these experiments suggested that the effect of sero¬ 
tonin could not be categorized simply as promoting either sleep or waking, in 
that many of the drugs have effects both on waking and sleep. In humans, the 
most consistent effect is a reduction of REM sleep [40], There is usually no 
sedative effect, but the antidepressant effect tends to improve insomnia com¬ 
plaints, although insomnia is a side effect with some SSRIs. In cats and rats, de¬ 
crease of REM sleep or paradoxical sleep has also been consistently reported. 
However, there is also a tendency to a biphasic effect on sleep, as with the early 
results following serotonin administration. In rats, increased waking succeeded 
by increased SWS or SWS-2 has been reported after several SSRIs [67-71], In 
cats also, effects following acute administration of SSRIs are biphasic. Waking 
is increased initially, then after a delay of around 2 h there is a SWS increase, 
particularly SWS-2 with delta activity [72, 73], This effect is potentiated follow¬ 
ing 5-HTP pretreatment [74], The findings support the idea that serotonergic 
stimulation yield complex effects on the sleep-waking axis, both sleep-incom¬ 
patible and sleep-promoting effects [56, 57], The increase in waking is accom¬ 
panied by behavioral and motor phenomena and may be secondary to those 
[73], The biphasic effect is potentiated by an adenosine A, antagonist, suggest¬ 
ing modulation of serotonin release by adenosine [75], 

There are regional differences in effects of different SSRIs. The synchroniz¬ 
ing effect is less pronounced both in cats and rats following an SSRI with low 
potency in the dorsal raphe and the descending raphe projection [68, 73], Thus, 
the localization of the serotonergic effect may be important for the type of ef¬ 
fects on sleep and waking. 


Diversity of serotonergic neuronal activity 

The description of dorsal raphe serotonergic neuron activity cited above [42, 
45-47], with highest activity in waking and a reduction of activity through 
SWS into REM sleep, indicated that these neurons could not be sleep promot¬ 
ing. Some dorsal raphe neurons, however, also presumably serotonergic, ex- 
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hibit other firing patterns with highest activity during REM sleep or during 
SWS [76], Also, there has been some doubt about the method of identification 
of DRN neurons on electrophysiological characteristics, in that some neurons 
presumed to be serotonergic on basis on their firing properties are not immu- 
noreactive for 5-HT or tryptophan hydroxylase [77], A recent study reports that 
cells with firing patterns presumed to be that of serotonergic cells, increased or 
did not change their firing pattern during sleep [78], 

The effects of the serotonergic neuronal activity are both excitatory and in¬ 
hibitory. Increased firing of serotonergic neurons during waking suppresses the 
generation of sleep spindles in the thalamus [79], However, recent studies in 
the ferret thalamus indicate that the predominant action of serotonin in the 
thalamus is one of hyperpolarization, directly or via local intemeurons [80], 
Serotonergic inhibition of cholinergic, presumably waking-promoting neurons 
in the basal forebrain has also been demonstrated [81]. 


Current concept: Complex role of serotonin in modulation 
of sleep and waking 


The last two decades of research have made it increasingly clear that the con¬ 
cepts of serotonin as a sleep transmitter or as a waking transmitter are much 
too simple. As a neurotransmitter, acting on many different receptors, serotonin 
may be involved in many processes relevant for the control of both sleep and 
waking, depending on the localization in the brain, the type of receptor it acts 
on, and the current state of the individual. The last decades of research has 
shown that sleep is a complex process, and the concept that it is governed by 
a single brain structure or by a single neurophysiologically or neurobiochemi- 
cally activated mechanism is no longer feasible. 

In the following is a short outline of some areas and mechanisms relevant 
for sleep and waking, and their modulation by serotonergic neurotransmission. 
More comprehensive reviews on sleep mechanisms are found elsewhere 
[82-84], 


Sleep onset: Thalamo-cortical projections, sleep spindles and serotonin 

The work of Steriade and colleagues [85, 86] has been crucial for our under¬ 
standing of the role of the thalamus in sleep onset. The 7-14 Hz sleep spindles, 
which identify the onset of sleep in the EEG, are the result of a thalamo-corti¬ 
cal oscillatory process generating rhythmic burst activity by low threshold Ca 2+ 
spikes. GABAergic neurons of the reticular nucleus, thalamocortical relay cells, 
and cortical pyramidal cells participate in the spindle generation [85, 87], The 
burst activity of the reticular nucleus cells inhibits large numbers of thalamo- 
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cortical cells, which leads to the appearance of rhythmic 7-14 Hz inhibitory 
postsynaptic potentials in the thalamocortical relay cells, followed by rebound 
bursts of action potentials. The rhythm is transferred to cortical neurons, syn¬ 
chronized via feedback from the cortical cells to the reticular nucleus, and seen 
as sleep spindles in the EEG [85], During later stages of sleep, the spindle oscil¬ 
lations are progressively reduced and replaced by thalamocortical oscillations 
with slower frequencies, delta waves (0.5^1 Hz) [88] and slow oscillations [89, 
90], Hyperpolarization of the cells below -65 mV is essential for the generation 
of delta waves, which in contrast to the sleep spindle generation may take place 
in single cells: thalamic sensory relay cells and cortical cells [85] and basal fore¬ 
brain cells [81]. The delta wave activity in cortical cells is synchronized via local 
mechanisms or via thalamic interconnections [85], 

This oscillatory activity may be modulated by neurotransmitters, including 
serotonin. There is a dense serotonergic innervation of the reticular nucleus, 
possibly arising from the dorsal raphe nucleus or the nucleus raphe pontis. 
Serotonin has a potent excitatory action on the GABAergic reticular nucleus 
neurons, associated with the occurrence of single spike activity [63], However, 
within a certain range of the membrane potential, i.e., with moderate depolari¬ 
zation, there is an increased probability of rhythmic oscillations. This is consis¬ 
tent with a model for control of the reticular thalamic oscillations [91]. In this 
model it is proposed that the oscillating properties of the reticular nucleus de¬ 
pends on the level of the membrane potential, which may be modulated by se¬ 
rotonin and noradrenaline by the blocking of a potassium current (“leak K + ”). 
A moderate serotonergic input may slightly depolarize the reticular nucleus 
cells and generate oscillatory activity and sleep spindles. With no such input 
there is resting hyperpolarization and no oscillations, while strong serotonergic 
input leads to depolarization and a switch to single spike activity as in waking 
[63], This excitation of the reticular nucleus neurons may occur through activa¬ 
tion of 5-HT 7 receptors [64], 

During wakefulness, the reticular nucleus is inhibited by cholinergic input 
from the basal forebrain and the brainstem cholinergic nuclei [87], Neurotrans¬ 
mitters like acetylcholine, noradrenaline, histamine and glutamate have activat¬ 
ing influences on thalamocortical networks through depolarization of thalamo¬ 
cortical cells and reticular nucleus cells [80], However, apart from the excitatory 
input mentioned above, most other serotonergic input to the thalamus, includ¬ 
ing input to thalamo-cortical projection neurons, are inhibitory, making the 
role for serotonin in ascending activation less clear [80], 

The occurrence of the sleep spindles are associated with long periods of in¬ 
hibition of the thalamocortical cells, with the consequence that the incoming 
signals are blocked and the cerebral cortex is deprived of external signals. Thus, 
the spindle signals sleep onset and defines the transition from wakefulness to 
sleep. The onset of sleep requires reduction or absence of sensory stimuli that 
have access to generalized activating systems [86], One may speculate that a 
reduction in the individual’s activities and sensory input, as when going to bed 
and lying down in a dark and quiet room, would reduce ascending sensory in- 
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formation enough to start a disinhibition of the reticular nucleus and facilitate 
spindle bursts and sleep onset. 


The sleep-promoting basal forebrain/preoptic area 

This area has a long history of research on sleep-promoting functions. Based 
on von Economo’s findings in an insomniac subgroup of the patients suffering 
from encephalitis lethargica, Nauta [92] did transections of the anterior hypo¬ 
thalamus at the level of the optic chiasm in rats. He found that the rats displayed 
continuous motor activity until they died after a few days. Many years later 
it was demonstrated that sleep could be induced by stimulation of the basal 
forebrain/preoptic area in cats [43], Also, sleep was reduced after electrolytic 
preoptic lesions [44], A group of cholinergic cells that project monosynaptically 
to the entire limbic telencephalon and neocortex, modulating arousal and at¬ 
tention, is located here (reviewed in [93]). Sleep active neurons are found in the 
ventrolateral preoptic area (VLPO) [94] and in the median preoptic nucleus [95] 
and there are populations of cells that show c-Fos activation after sleep in these 
areas [96, 97], 

GABAergic neurons identified in the basal forebrain/preoptic area have been 
implicated in the sleep-promoting effects [93, 95], Many of the cells also con¬ 
tain galanin [98], Several studies suggest a reciprocal interaction between this 
area and noradrenergic locus coeruleus cells and serotonergic raphe neurons. In 
vitro data indicate that some of the VLPO cells are inhibited by serotonin [99], 
suggesting serotonergic input, and both afferent input from [100] and efferent 
projections to the dorsal raphe nucleus [98, 101] have been demonstrated. Thus, 
it is possible that serotonergic raphe neurons may modulate sleep-promoting 
cells in the VLPO, and, vice versa, that GABAergic (and/or galaninergic) VLPO 
cells may modulate the activity of serotonergic raphe neurons and contribute 
to the decrease of activity during NREM sleep and REM sleep. The role of the 
dorsal raphe nucleus and serotonin in this context has thus been viewed as part 
of an arousal system, also comprising noradrenergic, dopaminergic, histamin- 
ergic and other input to the basal forebrain and lateral hypothalamus [65], The 
in vitro inhibition by serotonin of GABAergic VLPO neurons [99] supports 
such a view. However, a serotonergic inhibition of cholinergic, presumably 
waking-promoting neurons in the basal forebrain has also been demonstrated 
in vitro [81]. Also, microinjection of serotonin into the nucleus basalis in rats 
in vivo increases slow wave activity [102], Together with the demonstrated in¬ 
creased diversity of dorsal raphe neuron firing, this suggest a more complex 
role of serotonin in modulating sleep and waking in the basal forebrain area, 
more in line with the complex results of administration of SSRIs. 

Recent studies points towards a role of basal forebrain GABAergic cells for 
sleep homeostatic processes. During the light period, GABAergic neurons in 
the median preoptic nucleus express increased c-Fos reactivity after sleep de¬ 
privation compared with spontaneous sleep, while c-Fos reactivity in the VLPO 


Changing concepts on the role of serotonin 


GABAergic neurons is most prevalent after spontaneous sleep and recovery 
sleep, suggesting roles for these two areas in homeostatic sleep regulation [103], 
It has been demonstrated that sustained waking increase GABA a receptors on 
cholinergic cells in the basal forebrain, the receptors then decrease following 
inactivity during sleep. This could reflect increased GABAergic inhibition of 
cholinergic cells after prolonged waking and diminished inhibition following 
sleep and could thus represent a homeostatic process regulating cholinergic cell 
activity [104], 


The mesopontine tegmental cholinergic nuclei 

The laterodorsal tegmental (LDT) nucleus and the pedunculopontine tegmen¬ 
tal nucleus (PPT) in the mesopontine tegmental area are considered part of the 
reticular activating system [83], They project to many brain areas, including 
the thalamus. Some of the cells are active during REM sleep, some also dur¬ 
ing waking [105], There are projections from the dorsal raphe neurons to these 
nuclei [106], The REM-on cells are inhibited by serotonin [105, 107], but the 
wake-on cells are not [105], The inhibition of the REM-on cells follows the fir¬ 
ing pattern of the serotonergic neurons, with almost silence during REM sleep, 
and is considered to be a major factor in the regulation of REM sleep [108], 
As the LDT and PPT also contain neurons that are active during waking, they 
are also important for the activation processes (EEG desynchronization) in the 
thalamus during waking as well as during REM sleep [109, 110]. 


The waking areas of the ventrolateral hypothalamus 

Recent electrophysiological studies indicate that the median preoptic nucleus 
modulates the activity of arousal- and sleep-related neurons in the periforni- 
cal-lateral hypothalamus, containing histaminergic, glutamatergic and pepti¬ 
dergic (hypocretin/orexin ) cells [95], The histaminergic neurons are located in 
the tuberomammilary nucleus in the posterior hypothalamus. The neurons are 
most active during waking and promote waking via projections to widespread 
brain areas, including the cerebral cortex and the mesopontine tegmental nuclei 
brains [111]. The hypocretin neurons are located in the lateral hypothalamus. 
They project to areas that may be involved in sleep and waking: the tuberomam¬ 
milary nucleus, the locus coeruleus, the raphe nuclei, the PPT and LTP and the 
nucleus tractus solitarius [112], Some but not all narcoleptic patients are defi¬ 
cient of hypocretin in the spinal fluid [113], Hypocretin neurons are considered 
important for maintaining waking, and thereby, inversely, for sleep. The effects 
may be mediated via the tuberomammilary nucleus and histamine [114], Sero¬ 
tonin inhibits hypocretin neurons in vitro [115] as well as in vivo [116], but the 
unilateral administration of serotonin to the hypocretin neurons did not alter 
the sleep-waking profile. 
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Concepts on the role of serotonin in REM sleep 

The first concept of the role of serotonin for REM sleep was that of a seroto¬ 
nergic “priming” mechanism that would trigger the appearance of paradoxical 
(REM) sleep [10]. This was based on findings following lesion of the raphe 
system: REM sleep was seen only when SWS reached a threshold of 15%. Also, 
following pCPA administration, the rate of occurrence of REM sleep depended 
on the level of brain serotonin. It soon became clear, however, that the rela¬ 
tionship was inverse. Precursor loading in animals, as described above, reduced 
REM sleep, as did administration of serotonin reuptake inhibitors presumably 
increasing synaptic serotonin both in humans [40] and animals. A model of 
sleep cycle oscillation describing the alternation between SWS and REM sleep 
postulated either the locus coeruleus noradrenaline-containing neurons or the 
dorsal raphe nucleus as the REM sleep inhibitory area [117]. Also, it became 
evident that cholinergic nuclei in the mesopontine tegmentum were important 
for REM sleep. The findings of DRN neuron firing during sleep described 
above [42, 45^47] indicated that serotonergic neuron activity was at its lowest 
during REM sleep. After it was demonstrated that serotonin hyperpolarizes the 
mesopontine tegmental cholinergic neurons [107], the concept was established 
that cholinergic LDT and PPT neurons actively induce REM sleep when the 
serotonergic inhibition of these neurons diminish [108], 

Another area that has been implicated in the generation of REM sleep is an 
area adjacent to the locus coeruleus, peri-locus coeruleus alpha in the medio- 
dorsal pontine tegmentum [84], This area is not suppressed by serotonin [118], 
The different areas implicated in REM sleep may be important for the different 
physiological aspects of this sleep stage (atonia, PGO activity, EEG desynchro¬ 
nization), and these areas may interact to generate REM sleep [84], 

There is a complex interaction of serotonin and other neurotransmitters and 
neuromodulators in the regulation of REM sleep. GABA release in the dor¬ 
sal raphe neurons may modulate REM sleep [119]. Nitric oxide (NO) acts as 
a brain intracellular messenger and modulator of neurotransmitter release. It 
is colocalized with serotonergic dorsal raphe neurons in rats and with cholin¬ 
ergic LDT-PPT neurons, and may modulate REM sleep [120]. Hypothalamic 
prolactin is thought to participate in the modulation of neurotransmission in¬ 
volved in REM sleep generation [121], The distribution of neurons described 
as prolactin immunoreactive is similar to the distribution of hypocretin/orexin 
neurons, and it has been demonstrated that hypocretin/orexin and prolactin 
coexist in the same neurons [122], Thus, there are possibilities of an interplay 
between hypocretin/orexin, prolactin, and serotonin in sleep modulation and in 
narcolepsy. 

Recent research adds to the complexity of REM sleep mechanisms. Lesions 
and c-Fos activity studies suggest that areas dorsal and medial to the YLPO 
cluster have a role in the regulation of REM sleep [123, 124], This has been 
confirmed by another group whose research also suggests that subsets of neu¬ 
rons in the medial preoptic nucleus and VLPO are more closely associated with 
homeostatic REM sleep pressure than with REM sleep amount [125], 
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A humoral effect of serotonin on sleep? 

Jouvet [1] has suggested that serotonin released in the preoptic region during 
waking may participate in a homeostatic sleep factor process. The clock-like 
action of dorsal raphe neurons may be marking duration and intensity of wak¬ 
ing, then herald a cascade of genomic events that will trigger sleep onset. Such 
a chain of events may involve the modulation by serotonin of preoptic-YLPO 
area neurotransmitter projections as described above, or, possibly, serotonergic 
modulation of sleep-promoting hormones. 


A different concept: Modulation of motor activity 

This concept is based on findings of a strong positive relationship between mo¬ 
tor activity and the firing of pontine and medullary serotonergic neurons. These 
neurons are activated above active waking level in association with increased 
muscle tone or tonic motor activity, especially if the motor activity is repetitive 
(central pattern generating mode: grooming, licking, etc.). The primary func¬ 
tion of such increased neuronal activity is postulated to facilitate motor func¬ 
tion, and to coordinate autonomic and neuroendocrine function with existing 
motor demand. During active inhibition of gross behavior, like during the ori¬ 
enting response, the activity of a subgroup of pontine serotonergic neurons is 
suppressed, disfacilitating motor output [126], 


Conclusion 

During the last five decades, the concept of the role on serotonin in sleep has 
changed several times. The ideas of serotonin as a sleep transmitter and the 
dorsal raphe nucleus as a sleep “center” were simple, and fascinating, and crea¬ 
ted an enormous amount of research and a dedicated group of people working 
in the new field of sleep research. The change from this concept to one entirely 
opposite came as a result of new methodology, the ability to record cellular 
activity from unanesthetized, spontaneously sleeping animals. 

During the last two decades it has become increasingly clear that both these 
earlier concepts were too simple. There has been an enormous development in 
our understanding of the nervous system and the complexity of neurobiologi- 
cal mechanisms. This in turn is based upon an enormous development in tech¬ 
nology and research methods. 

Today, we realize that serotonergic neurotransmission plays a role both in 
sleep and waking. The role is complex and depends on which neurons are fir¬ 
ing, their projection site, which postsynaptic receptors are present at this site, 
and, not the least, on the functional state of the system and the organism at the 
particular moment. 
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Abstract 

The role of serotonergic systems in regulation of behavioral arousal and sleep-wake cycles 
is complex and may depend on both the receptor subtype and brain region involved. In¬ 
creasing evidence points toward the existence of multiple topographically organized sub¬ 
populations of serotonergic neurons that receive unique afferent connections, give rise to 
unique patterns of projections to forebrain systems, and have unique functional properties. 
A better understanding of the properties of these subpopulations of serotonergic neurons 
may aid in the understanding of the role of serotonergic systems in regulation of beha¬ 
vioral arousal, sleep-wake cycles and other physiological and behavioral responses attri¬ 
buted to serotonin. In this chapter, we outline evidence for multiple serotonergic systems 
within the midbrain and pontine raphe complex that can be defined based on cytoarchitec- 
tonic and hodological properties. In addition, we describe how these topographically orga¬ 
nized groups of serotonergic neurons correspond to the six major ascending serotonergic 
tracts innervating the forebrain. 


Introduction 

The relationship between serotonergic systems and regulation of sleep-wake 
cycles is complex. A review of studies using serotonin-selective lesioning tech- 


26 


Christopher A. Lowry et al. 


niques, administration of serotonin precursors or selective serotonin re-uptake 
inhibitors, and studies using serotonin receptor subtype-specific agonists and 
antagonists reveals that the role of serotonin in regulation of sleep-wake cycles 
may be dependent on the specific receptor subtype and brain region involved 
[1], Consequently, a better understanding of the topographical organization of 
serotonergic neurons projecting to different forebrain circuits should be helpful 
in understanding the complex roles of serotonergic signaling in regulation of 
sleep-wake cycles. In this chapter we outline the evidence that different subpo¬ 
pulations of serotonergic neurons in the midbrain and pontine raphe complex 
have unique anatomical and functional properties and play different roles in 
the regulation of circadian rhythms, sleep and waking. 

The possibility that subpopulations of serotonergic neurons may play dif¬ 
ferent roles in the regulation of behavioral arousal is supported by single-unit 
recording studies in behaving animals. Studies in cats by Rassmussen and col¬ 
leagues [2] have identified two subtypes of serotonergic neurons based on their 
behavioral correlates. Type I serotonergic neurons have elevated neuronal fir¬ 
ing rates during active waking and have decreased neuronal firing during quiet 
waking and slow-wave sleep. Type I neurons virtually cease firing during para¬ 
doxical sleep. Type II serotonergic neurons on the other hand maintain a rela¬ 
tively constant firing rate regardless of the level of behavioral arousal; these 
neurons are just as active during paradoxical sleep as they are during active 
waking. Type I and Type II serotonergic neurons also differ in their responses 
to sensory stimulation. Type I neurons respond to phasic auditory or visual 
stimulation with a short latency, short duration excitation. In contrast, Type 
II neurons respond with a short latency, long duration inhibition. Although it 
is not yet known if these differences arise from different intrinsic properties or 
different afferent regulatory mechanisms, these data highlight the diversity of 
serotonergic neurons and their behavioral correlates. Type II serotonergic neu¬ 
rons were only found in a small region between the dorsal raphe nucleus (DR) 
and nucleus centralis superior (median raphe nucleus; MnR) in the caudal part 
of the midbrain and pontine raphe complex. This region, located between the 
medial longitudinal fasciculi, is now referred to as the interfascicular part of 
the dorsal raphe nucleus (DRI). Given their unique properties, it is likely that 
Type I and Type II serotonergic neurons play different roles in the regulation of 
motor activity and sleep-wake cycles. 

Other studies also have found tantalizing clues supporting diversity in the 
physiological properties of serotonergic neurons. Serotonergic neurons in the 
DR and MnR appear to be differentially sensitive to 5-HT 1A receptor-media¬ 
ted autoinhibition [3-5], In addition, a subpopulation of serotonergic neu¬ 
rons has been identified whose firing rates are phase-coupled to hippocampal 
theta [6], Hippocampal theta (oscillations in the frequency range of 4-8 Hz) 
occurs selectively during exploratory behaviors and paradoxical sleep, while 
large-amplitude irregular hippocampal activity is associated with quiet waking, 
consummatory behavior, and slow-wave sleep [7], Atypical serotonergic neu¬ 
rons with fast firing rates (>8 Hz) that were phase-coupled to the hippocampal 
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theta rhythm were identified using in vivo juxtacellular recording and labeling 
techniques [6], It is likely that these atypical serotonergic neurons and other 
atypical serotonergic neurons have been underrepresented in electrophysiologi- 
cal recording paradigms because they do not have properties that were consid¬ 
ered diagnostic of a serotonergic phenotype [8], Consequently, it is likely that 
the diversity of physiological properties among subpopulations of serotonergic 
neurons is underestimated. Other studies support a high level of electrophysio- 
logical diversity among serotonergic neurons in the DR and diversity among 
serotonergic neurons with respect to their relationships between neuronal fir¬ 
ing and specific phases of the sleep-wake cycle [9-13], Some populations of 
putative atypical serotonergic neurons appear to be topographically organized 
within the DR [9]. 

The typical focus on the DR and MnR as the main serotonergic cell groups 
with ascending projections to forebrain structures may perpetuate a “fallacy 
of the excluded middle”. As discussed below, other cell groups [i.e., the B9 (su- 
pralemniscal cell group)] appear to consist of an equal or greater number of 
serotonergic cells relative to the MnR, and different cell groups, and even sub- 
regions of these groups, appear to have unique chemoarchitectonic, hodologi- 
cal (connectivity), and functional properties. Consequently, here we attempt to 
describe the unique properties of several topographically organized subgroups 
of serotonergic neurons within the midbrain and pons in the hope of providing 
an anatomical foundation for further research related to the diversity of brain¬ 
stem serotonergic neurons. Although there are grounds to discuss each popu¬ 
lation of serotonergic neurons separately based on their anatomical location, 
it should be remembered that functional properties of serotonergic neurons 
within the raphe complex may not correspond with divisions that are made on 
cytoarchitectonic grounds. 

In this chapter we present a detailed account of the topography of seroto¬ 
nergic neurons within the midbrain and pontine raphe complex in the hopes of 
identifying subsets of serotonergic neurons that may play differential roles in 
the regulation of specific aspects of sleep and arousal or other physiological or 
behavioral functions. It is now clear that topographically organized subpopula¬ 
tions of serotonergic neurons have unique afferent connections and, therefore, 
would be expected to be differentially regulated under different physiological or 
behavioral states [14, 15], In addition, topographically organized subpopula¬ 
tions of serotonergic neurons each give rise to efferent projections to specific 
forebrain structures, supporting the hypothesis that different subpopulations of 
serotonergic neurons modulate the activity of different neural systems [16-18], 
We provide evidence that the sources of the six major ascending serotonergic 
fiber tracts originally identified by Azmitia and Segal [19, 20], each of which 
innervates a different set of functionally related target structures, can be identi¬ 
fied with some degree of certainty. Identification of the sources of the major 
ascending serotonergic fiber tracts innervating the forebrain should provide a 
foundation for future investigations of the physiological and behavioral func¬ 
tions of anatomically and functionally distinct serotonergic systems. 
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Topography of serotonergic neurons within the midbrain 
and pontine raphe complex 


Nomenclature 

The nomenclature for brainstem serotonergic cell groups has undergone many 
revisions since the initial characterization, using formaldehyde-induced histo- 
fluorescence methods, of the distribution of brainstem serotonergic neurons in 
the rat brain by Dahlstrom and Fuxe in 1964 [21] (see Tab. 1). In this chapter 
we simply refer to each cell group based on its anatomical location with refer¬ 
ence to a standard stereotaxic atlas of the rat brain [22], These cell groups are 
illustrated in a mid-sagittal plane of the rat brain in Fig. 1. 


Table 1 Nomenclature for groups of brainstem serotonergic neurons according to Dahl¬ 
strom and Fuxe [21], 


Alphanumeric 

designation 

Cytoarchitectonic regions 

Estimated cell 
numbers (rat) [ref] 

B1 

Raphe pallidus nucleus (RPa) 

Caudal ventrolateral medulla (CVL) 

1500 [23] 

B2 

Raphe obscurus nucleus (ROb) 

1300 [23] 

B3 

Raphe magnus nucleus (RMg) 

Rostral ventrolateral medulla (RVL) 

Lateral paragigantocellular reticular nucleus (LPGi) 

1600 [23] 

B4 

Central gray of the medulla oblongata 


B5 

Pontine raphe nucleus (PnR) 


B6 

Dorsal raphe nucleus, caudal part (DRC) 


B7 

Dorsal raphe nucleus (DR) 

Caudal linear nucleus (CLi) 

15 191 [28] 

B8 

Median raphe nucleus (MnR) 

4114 [28] 


Apical subdivision of the interpeduncular nucleus 
(IPA) 

405 [243] 

B9 

Medial lemniscus (ml) 

4571 [28] 


Pontine reticular nucleus, oral part (PnO) 4 

Lateral subdivision of the interpeduncular nucleus 
(IPL) 

1948 [28] 


"Included in the pontomesencephalic reticular formation (PMRF) by Vertes and Crane [28], 
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Fig. 1 Drawing of a mid-sagittal section of rat brainstem illustrating the distribution of 
serotonergic neurons within the midbrain, pons, and medulla. Each dot represents a sing¬ 
le tryptophan hydroxylase-like-immunoreactive neuron within a single 30-pm section; 
therefore only neurons in the midline are illustrated. Serotonergic neurons within the su- 
pralemniscal cell group (B9), lateral wings of the dorsal raphe nucleus [ventrolateral part 
of the dorsal raphe nucleus (DRVL) and ventrolateral periaqueductal gray (VLPAG) 
regions], pontomesencephalic reticular formation [PMRF; including the oral part of 
the pontine reticular nucleus (PnO) and medial part of the deep mesencephalic nucleus 
(DpMe)], and ventrolateral part of the interpeduncular nucleus are not illustrated. For 
the location of serotonergic neurons in these lateral structures see Fig. 2. The drawing to 
the upper right illustrates the location of the brainstem in relation to the rest of the rat 
brain. The medial longitudinal fasciculus, which demarcates the border between the dor¬ 
sal raphe nucleus (DR) dorsally and the interfascicular part of the dorsal raphe nucleus 
(DRI) and median raphe nucleus (MnR) ventrally, is shown diagrammatically as a gray 
line. Dashed gray lines demarcate borders between the midbrain (left), pons (middle) 
and medulla oblongata (right). Tryptophan hydoxylase-like-immunoreactive neurons 
rostral to -7.0 mm Bregma, and some in the caudal linear nucleus (CLi) and rostral part 
of the DR (DR; gray dots) likely represent cross-reactivity with tyrosine hydroxylase 
in catecholaminergic neurons, which are common in the rostral DR, CLi, rostral linear 
nucleus (RLi) and hypothalamus, but absent in the caudal parts of the midbrain raphe 
complex and in the pontine raphe complex. Aq, cerebral aqueduct; rostral part; DRC, 
dorsal raphe nucleus, caudal part; DRD, dorsal raphe nucleus, dorsal part; DRV, dorsal 
raphe nucleus, ventral part; IPA, interpeduncular nucleus, apical subdivision; mlf, me¬ 
dial longitudinal fasciculus; RMg, raphe magnus nucleus; ROb, raphe obscurus nucleus; 
RPa, raphe pallidus nucleus; xscp, decussation of the superior cerebellar peduncle. The 
scale on the bottom illustrates the anterior/posterior position with reference to Bregma 
(mm). Scale bar, 1 mm; [adapted from [84] with permission] 
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Topographically organized subpopulations of serotonergic 
neurons within the midbrain raphe complex 


It is apparent from Fig. 1 that there is a clear separation between the superior 
group of serotonergic neurons in the midbrain and pons and the inferior group 
of serotonergic neurons in the medulla. These clusters of serotonergic neurons 
arise from completely separate groups of cells during development (see Fig. 6 
in [23]). Indeed, serotonergic neurons in the inferior group form about 2 days 
after the superior group [24, 25], The early development of serotonergic neu¬ 
rons has been reviewed by Jacobs and Azmitia [23], At 14 days gestation, se¬ 
rotonergic neurons have migrated ventrally from the ventricular surface and 
form bilateral groups near the midline. At 15 days gestation, the superior group 
is composed of two groups of cells, a dorsolateral group and a ventrolateral 
group. At 17 days gestation the ventrolateral group separates into the MnR 
and the DRI, providing developmental support for the argument that these 
groups of serotonergic neurons, located predominantly in the pons, are com¬ 
ponents of a larger functional grouping [19, 26], Indeed, most structures in¬ 
nervated by the MnR are also innervated by the DRI (see below). Also visible 
in the pontine region are the serotonergic neurons near the aqueduct in the 
caudal part of the DR (DRC) and a small cluster of serotonergic neurons in 
the apical subnucleus of the interpeduncular nucleus (IPA), which is continu¬ 
ous with the MnR located just caudal to it. In contrast, the main body of the 
DR is located within the caudal midbrain. A continuous column of cells is 
apparent in the dorsal part of the DR (DRD), which, in places, is separated 
from the ventral part of the DR (DRV) by a cell-sparse zone. Below the medial 
longitudinal fasciculus (mlf) in front of the decussating fibers of the superior 
cerebellar peducle, the cells within the caudal linear nucleus (CLi) are evident. 
Thus, the midbrain and pontine raphe complex has an oblique orientation in 
the brain, aligned along the mesopontine junction. These cell groups are il¬ 
lustrated in Fig. 2 in a coronal plane following in situ hybridization histochem¬ 
istry for detection of serotonin transporter mRNA expression (Lowry et al., 
unpublished), which is believed to be a specific marker of serotonergic neurons 
in the brainstem raphe complex. Differences in the intensity of signal represent 
differences in cell number, cell packing, and possibly in single-cell mRNA ex¬ 
pression levels among different components of the midbrain and pontine raphe 
nuclei [27], 

Serotonergic neurons in the lateral cell groups are not represented in Fig. 1, 
but are visible in Fig. 2. The lateral groups include serotonergic neurons in 
the B9 serotonergic cell group, the lateral subnucleus of the interpeduncular 
nucleus (IPL), the ventrolateral part of the DR and adjacent ventrolateral peri¬ 
aqueductal gray (DRVL/VLPAG region), and the pontomesencephalic reticu¬ 
lar formation (PMRF). The B9 serotonergic neurons are located within and 
dorsal to the medial lemniscus, forming a crescent-shaped line of cells ventral 
to the PnO in the rostral and mid-rostrocaudal parts of the raphe complex. 
Serotonergic neurons in the DRVL/VLPAG region, the “lateral wings” of the 
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DR, are readily apparent lateral to the main body of the mid-rostrocaudal DR. 
Serotonergic neurons in the PMRF are predominantly restricted to the medial 
reticular zones, that is the oral part of the pontine reticular nucleus (PnO) and 
medial parts of the deep mesencephalic nucleus (DpMe) [28], Serotonergic neu¬ 
rons within the PMRF are not readily apparent in Fig. 2 because individual 
cells are scattered throughout the reticular formation, making it difficult to dis¬ 
cern the autoradiographic signal. They are easily discerned at higher magnifica¬ 
tion (data not shown). 

Below we describe the cytoarchitectonic and morphological properties, che- 
moarchitecture, afferent and efferent connections, and functional properties of 
each of the main groups of serotonergic neurons that can be defined based on 
cytoarchitectonic criteria. Following this, we define how each of these groups 
contributes to the six main ascending serotonergic tracts innervating the fore¬ 
brain. Due to space restrictions, several groups will not be considered in detail 
here, including the apical and lateral subnuclei of the interpeduncular nucleus, 
the CLi, the B9 (supralemniscal) cell group, the PMRF and the pontine raphe 
nucleus (PnR). For discussions of these cell groups, the reader is referred to 
several excellent articles and reviews [23, 27-30], 


The dorsal raphe nucleus 

The DR, located in the rostral pontine and caudal midbrain tegmentum, con¬ 
tains the largest group of serotonergic neurons within the midbrain and pon¬ 
tine raphe complex, approximately 15 000 serotonergic neurons in the rat brain 
(Tab. 1; [28]). It can be divided into several subregions based on cytoarchitec¬ 
tonic grounds, including the rostral, dorsal (DRD), ventral (DRV), ventrolat¬ 
eral (DRVL), caudal (DRC), and interfascicular (DRI) parts. Four cell types 
are observed: small and round, medium-sized and fusiform or bipolar, large 
and fusiform, and very large and multipolar [27], Although medium-sized cells 
are found uniformly throughout the nucleus, other cell types are preferentially 
found in specific subregions of the nucleus [27], 

Neurons within the DR express many different peptides including enkepha¬ 
lin, neurotensin (NT), cholecystokinin (CCK), substance P, and somatostatin 
[31-35], and neurotransmitters, including y-amino-butyric acid (GABA), glu¬ 
tamate, aspartate, and nitric oxide [36-38] (Tab. 2). In addition, serotonergic 
neurons in the DR co-express a number of neuropeptides and neurotrans¬ 
mitters (Tab. 2). The chemoarchitecture of the DR varies across the different 
subdivisions of the DR. For example, NADPH diaphorase histochemistry has 
revealed NADPH activity in serotonergic neurons within the DR, consistent 
with the presence of nitric oxide synthase-immunoreactive neurons [39], but 
the degree of co-localization with serotonin varies among the different subdivi¬ 
sions of the DR [38, 40, 41], NADPH diaphorase activity is observed in ap¬ 
proximately 10% of serotonergic neurons in the rostral DR and DRVL/VLPAG 
region and 70% of serotonergic neurons within the DRD and DRV. 
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Fig. 2 Topography of serotonergic neurons in the midbrain and pontine raphe complex. 
Autoradiographic images illustrate the distribution of serotonin transporter mRNA ex¬ 
pression in coronal rat brain sections showing the topographical organization of sero¬ 
tonergic neurons within the midbrain and pontine raphe complex with a high level of 
anatomical resolution (84-pm intervals). Serotonergic neurons in the pontomesence¬ 
phalic reticular formation (PMRF) are not readily seen at this resolution because the 
isolated cells are scattered throughout the oral part of the PnO and the mesencephalic 
reticular formation above it (both located lateral to the midline). B9, B9 or supralem- 
niscal cell group; B9d, B9, dorsal part; DRI, dorsal raphe nucleus, interfascicular part; 
IPL, interpeduncular nucleus, lateral subdivision (see also Fig. 1 legend). Numbers in 
the right hand corner of each panel are arbitrary designations of rostrocaudal levels; 
17 (most rostral) through -6 (most caudal). Scale bar, 1 mm 


Rostral part of the DR 

The rostral part of the DR for the purposes of this discussion is defined as the 
rostral one-third of the DR extending to approximately -7.64 mm Bregma in 
the rat brain [17]. The rostral DR contains medium-sized serotonergic neurons 
[27], At its rostral extreme, a single thin midline group of serotonergic neurons 
is present extending from the cerebral aqueduct dorsally to the CLi ventrally 
(Fig. 2). More caudally, these cells begin to fan laterally in the dorsal part of 
the nucleus and remain constricted by the medial longitudinal fasciculi in the 
ventral part (Fig. 2). Tryptophan hydroxylase 2, serotonin transporter, 5-HT 1A 
receptor, and 5-HT 1B receptor mRNA expression are all detectable within the 
rostral DR [42], In the caudal part, expression of all of these mRNAs is greater 
in the ventral portion relative to the dorsal portion [42], consistent with the 
higher density of serotonergic neurons in the ventral region [27], 
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Chemoarchitecture 

The rostral DR contains a population of small dopaminergic neurons that 
extends rostrally into the dorsomedial portion of the CLi [43, 44], These are 
scattered throughout the entire rostrocaudal extent of the midline rostral DR 
[43^15], Approximately 1000 dopaminergic cell bodies are found in the DR in 
the rat brain [45], Caudally, only a few small tyrosine hydroxylase-immunoreac- 
tive neurons are present just below the cerebral aqueduct in the DRD [44, 45], 
NT and CCK are commonly found to be co-localized with dopamine and, as 
might be expected, the rostral DR is notable for a high number of NT- [46] and 
CCK-expressing neurons [47], In addition, a portion of the dopaminergic cells 
in the rostral DR are immunoreactive for both calretinin (CR) and calbindin- 
D28k (CB) [48], CR- and CB-immunoreactive cells are scattered throughout 
the rostral DR [44], Several other neurotransmitter- and neuropeptide-express¬ 
ing cell types have been described in the rostral DR (Tab. 2). 


Affevents 

(S-Endorphin-containing fibers from the hypothalamic arcuate nucleus inner¬ 
vate the rostral DR as well as the rostral DRVL/VLPAG region [49], This is 
consistent with the finding that retrogradely labeled cells are observed in the 
hypothalamic arcuate nucleus following injections of retrograde tracer into the 
dorsal part of the rostral or mid-rostrocaucal DR or DRVL regions of the 
DR, but not ventral parts of the rostral, mid-rostrocaudal, or DRVL regions 
[14], The innervation of the rostral part, but not the caudal part, of the DR 
by the (i-endorphin-containing fibers overlaps with the distribution of those 
serotonergic neurons projecting to the caudate putamen, but not those in¬ 
nervating the septum and hippocampus [16, 50], Consistent with these ana¬ 
tomical relationships, morphine increases tryptophan hydroxylase activity in 
the DR, cortex, and caudate putamen, but not in the MnR, hippocampus, or 
nucleus accumbens, and increases extracellular serotonin in the caudate puta¬ 
men, but not the hippocampus or nucleus accumbens [51, 52], Disinhibition 
of serotonergic neurons within the DR by opioids is thought to be dependent 
on inhibition of local GABAergic intemeurons [53, 54] and involves actions in 
the DR but not the MnR [51, 52], GABAergic neurons within the DRD, but 
not the DRV, receive synaptic input from [i-endorphin-containing fibers aris¬ 
ing from the arcuate nucleus [49], A topographically organized projection from 
the arcuate nucleus to the rostral DR is supported by findings that numerous 
corticotropin-like intermediate lobe peptide (CLIP)/adrenocorticotropic hor¬ 
mone (ACTH)-immunoreactive fibers are present in the rostral DR and dorsal 
part of the mid-rostrocaudal DR, while only a few are present in other DR 
regions [55], 
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Efferents 

Serotonergic neurons in the rostral DR project heavily to the caudate putamen 
[16, 56-58] but make no contribution to some limbic structures including the 
medial entorhinal cortex and hippocampus [16, 59], Neurons in the rostral DR 
also project to the substantia nigra and indeed most neurons in the rostral DR 
that project to the substantia nigra also give rise to collateral projections to the 
caudate putamen [60], supporting the hypothesis that individual serotonergic 
neurons give rise to functionally related targets. Other forebrain targets of the 
rostral DR include the subthalamic nucleus [61], substantia innominata [62], 
and the motor cortex [63], In contrast to the serotonergic neurons in the rostral 
DR, dopaminergic neurons in the DR project strongly to the nucleus accum- 
bens, lateral septum and medial prefrontal cortex, with very few projections to 
the caudate putamen, a pattern that is similar to mesolimbocortical dopaminer¬ 
gic neurons in the ventral tegmental area [64], 


Functional topography 

Consistent with an abundance of mesolimbocortical dopaminergic neurons in 
the rostral DR [64], intracranial self stimulation is reliably obtained in the dor¬ 
sal raphe nucleus [65, 66], Higher response rates and lower thresholds of stimu¬ 
lation are obtained in the rostral DR, while the caudal DR is characterized by 
lower rates and a higher threshold of stimulation [65], 

Studies of the effects of chronic exercise on serotonergic systems have re¬ 
vealed selective effects on gene expression within the rostral DR. Interestingly, 
wheel running for 6 weeks specifically decreases serotonin transporter and 5- 
HT 1B receptor mRNA expression within the rostral and mid-rostrocaudal DRV, 
but not the caudal DRV, while it increases 5-HT 1A receptor mRNA expression 
in the rostral and mid-rostrocaudal DRD, but not the caudal DRD [67], Fur¬ 
thermore, it blunts the effects of inescapable stress on c-Fos expression within 
the rostral and mid-rostrocaudal, but not the caudal, DRD and DRV [68], To¬ 
gether, these data support an association of the rostral and mid-rostrocaudal 
DR (those parts with serotonergic neurons projecting to the caudate putamen 
[16, 56, 57]) with adaptive responses to chronic exercise. 


Ventral part of the DR 

The DRV extends from the caudal border of the trochlear nuclei to the rostral 
border of the dorsal tegmental nuclei [22], It is bordered ventrally and laterally 
by the medial longitudinal fasciculi and the decussating fibers of the superior 
cerebellar peduncle, except in its most caudal portion where it merges with the 
DRI. The DRV is dominated by small, round serotonergic neurons [27], Sero¬ 
tonergic neurons are numerous and densely packed in the DRV, particularly in 
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its lateral portions [27], They are so densely packed and serotonergic fibers are 
so dense in this region that their dendritic processes could not be investigated 
using bright field microscopy [27], The DRV has the highest expression of tryp¬ 
tophan hydroxylase 2, serotonin transporter, 5-HT 1A receptor, and 5-HT 1B re¬ 
ceptor mRNA within the midbrain and pontine raphe complex [42], consistent 
with the high density of serotonergic neurons in this region [27], 


Chemoarchitecture 

The DRV contains NADPH diaphorase activity and cell bodies immunoreac- 
tive for GABA [53] and galanin [219] (Tab. 2). 


Affevents 

Generally, injections of retrograde tracer into the DRV label comparable or 
fewer cells than injections into the rostral, DRD, and DRVL/VLPAG regions 
of the DR [14, 15, 69], An exception may be the lateral orbital cortex. Indeed, 
injections of anterograde tracer into the lateral orbital cortex appear to pre¬ 
dominantly label the DRV region, with no or occasional fibers in the DRD or 
DRVL/VLPAG regions [14]. In addition, a small number of cells retrogradely 
labeled from the DRV were observed in the anterior, anterior cortical, and ba- 
somedial nuclei of the amygdala (parts of the main olfactory system of the 
amygdala [70]), following injections of retrograde tracer into the DRV, while no 
or occasional cells were observed following injections into other subdivisions 
of the DR [14]. 


Efferents 

The DRV is the main source of efferent projections to the sensorimotor cortex 
[63] and also contains numerous cells projecting to the ventrolateral orbital cor¬ 
tex [71], frontal cortex [72], motor cortex [63], visual cortex including cortical 
Areas 17 and 18a/b [63, 73], and barrel field cortex [74], It also contributes sub¬ 
stantially to the serotonergic projections to the caudate putamen [57], 


Functional topography 

The projections from the DRV to the caudate putamen and diverse cortical 
targets suggest that these neurons may be involved in multiple aspects of mo¬ 
tor and cognitive function. Imaging studies have found that activity in the 
lateral orbitofrontal cortex, a region that appears to selectively innervate the 
DRV region, is associated with negative reward anticipation, losing outcome, 
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and evaluation of wrong choices [75, 76], The pattern of efferent projections 
of the DRV suggest that it is integrated with cortico-striato-thalamo-cortical 
circuits that have been associated with obsessive compulsive disorder [77, 78] 
and Tourette’s syndrome [79, 80], and some of the prefrontal circuits associated 
with anorexia nervosa [81, 82], Evidence supports dysregulation of a serotoner¬ 
gic subsystem in obsessive compulsive disorder [83], 


Dorsomedial DR 

The DRD, like the DRV below it, extends from the caudal border of the 
trochlear nuclei to the rostral border of the dorsal tegmental nuclei [22], It is 
bordered dorsally by the cerebral aqueduct, ventrally by the DRV and laterally 
by the DRVL. The DRD is dominated by medium-sized, fusiform or bipolar 
cells oriented in the rostrocaudal direction [27], The DRD contains a compact 
cluster of serotonergic neurons in its central region, referred to as the DRD 
core region, and scattered serotonergic neurons in the surrounding regions, re¬ 
ferred to as the DRD shell region [84], Due to dense packing of cells, it was 
not possible to determine the dendritic morphology of neurons in the DRD 
core region, but those in the DRD shell region appear to have two dendrites 
that can be viewed over distances of 15-60 pm [27], The DRD has moderate 
tryptophan hydroxylase 2, serotonin transporter, 5-HT 1A receptor, and 5-HT 1B 
receptor mRNA expression that is relatively consistent throughout its rostro¬ 
caudal extent [42], 


Chemoavchitectuve 

The DRD is unique in that it contains a group of serotonergic neurons that 
co-express corticotropin-releasing factor (CRF) [85], This cluster of cells is sur¬ 
rounded by a dense plexus of neurokinin 1 (NKl ) receptor-immunoreactive 
fibers that are concentrated in the DRD region [85], Based on these unique 
neurochemical properties and the pattern of efferent projections from the 
DRD (see below), Commons and colleagues proposed that the DRD may have 
a potential role in affective disorders [85], 


Affevents 

Large numbers of neurons are retrogradely labeled within lateral, ventral, and 
medial parts of the bed nucleus of the stria terminalis following injections of 
retrograde tracer into the DRD, while only a small to moderate number is ob¬ 
served following injections into other subdivisions of the DR [14], In addition, 
The DRD, together with the DRVL/VLPAG region, is the main target of fibers 
descending from the infralimbic cortex to the DR [14], 
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Efferents 

The DRD gives rise to projections to a distributed system associated with 
stress- and anxiety-related physiological and behavioral responses [18], Antero¬ 
grade tracing studies reveal that CRF-containing fibers from the DRD inner¬ 
vate CRF-producing neurons in the central amygdaloid nucleus [85] involved in 
fear-related physiological and behavioral responses [86], These studies also re¬ 
veal that the DRD gives rise to a dense innervation of the dorsal hypothalamic 
area [85], involved in stress-induced autonomic, neuroendocrine and behav¬ 
ioral responses [87], and the bed nucleus of the stria terminalis [85], involved 
in regulation of anxiety-related behavior [88], Neurons in the DRD (together 
with neurons in the DRVL/VLPAG region) are retrogradely labeled following 
localized injections into the dorsolateral periaqueductal gray [89], a region im¬ 
plicated in regulation of fight-or-flight or panic-like autonomic and behavioral 
responses [90], Consistent with these findings, low intensity stimulation of the 
dorsolateral periaqueductal gray induces antidromic responses in DRD neu¬ 
rons in vitro [89], Collateral projections of chemically identified DRD seroto¬ 
nergic neurons to the nucleus accumbens [91], and medial prefrontal cortex [91] 
have been identified. Retrograde tracing studies have also demonstrated strong 
projections from the DRD to the basolateral amygdaloid nucleus [84, 92], cen¬ 
tral amygdaloid nucleus [31, 92-94], and bed nucleus of the stria terminalis 
[95]. 


Functional topography 

Anxiogenic drugs, including the inverse partial agonist at the benzodiazepine 
site on the GABA a receptor A-methyl-(3-carboline-3-carboxamide (FG-7142), 
the 5-HT 2A(2C receptor agonist m-chlorophenyl piperazine (mCPP), and the 
adenosine receptor antagonist caffeine, the anxiety-related neuropeptide uro- 
cortin 2 (Ucn 2), as well as social defeat, activate serotonergic neurons pre¬ 
dominantly in the DRD and DRC, regions of the DR that project to forebrain 
structures mediating anxiety-like behavioral responses [18, 84, 96-98], Like¬ 
wise, uncontrollable stress activates serotonergic neurons in the caudal DR, but 
not the rostral DR [99, 100], Injections of 8-OH-DPAT, or other drugs that 
inhibit serotonergic neuronal activity, into this region decrease anxiety-related 
behavioral responses (for references and review, see [101, 102]). These findings 
and the anatomical connections of the DRD (see above) have led to the hy¬ 
pothesis that this subregion of the DR may play an important role in regula¬ 
tion of anxiety-related physiological and behavioral responses [18, 103], and 
affective disorder [85], One study has found evidence for a selective increase 
in tryptophan hydroxylase expression that is restricted to the DRD region in 
human depressed suicide patients [104], A second study examining tryptophan 
hydroxylase 2 mRNA expression in depressed suicides also found evidence for 
regionally specific changes in tryptophan hydroxylase 2 expression in depressed 
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patients [105], Overall tryptophan hydroxylase mRNA expression was elevated 
in depressed suicides; regional analysis revealed, however, that tryptophan hy¬ 
droxylase 2 mRNA expression was 136% of controls in the DRD, compared to 
86% of controls in the DRV. 


DRVL/VLPAG region, “lateral wings” of the DR 

The “lateral wings” of the DR (DRVL/VLPAG region) are restricted to the mid- 
rostrocaudal part of the midbrain and pontine raphe complex [17]. Caudally, 
these neurons are found not in a ventrolateral position, but in a dorsolateral po¬ 
sition just below the plane of the ventral border of the cerebral aqueduct [17]. 
Throughout the rostrocaudal extent of the DRVL, many of the serotonergic 
neurons in this cluster are located not in the DR but in the adjacent ventrolat¬ 
eral periaqueductal gray (VLPAG) [42, 106], The DRVL/VLPAG is dominated 
by a group of very large, multipolar serotonergic neurons [27], A single process 
rapidly ramifies into two branches at the caudal surface of these cells; rostrally 
these cells have long processes extending dorsally as well as processes extending 
ventrally [27], The mid-rostrocaudal part of the DRVL/VLPAG has the highest 
expression of tryptophan hydroxylase 2, serotonin transporter, 5-HT 1A recep¬ 
tor, and 5-HT 1B receptor mRNA within this subregion [42], 


Chemoarchitectuve 

The DRVL/VLPAG region has a large population of GABAergic neurons that 
appear to be important in the regulatory control of DR serotonergic neurons 
[53, 107-109], 


Affevents 

The DRVL/VLPAG region is integrated with central autonomic control sys¬ 
tems. The DRVL/VLPAG region, relative to other subregions of the midbrain/ 
pontine raphe complex is almost exclusively targeted by afferents from the 
medial part of the nucleus of the solitary tract [110], the major recipient of af¬ 
ferent information from visceral sensory glossopharyngeal and vagal nerves. 
Using dual immunohistochemistry and light microscopy, Herbert revealed that 
both enpassant varicosities and presumed terminal varicosities arising from the 
medial part of the nucleus of the solitary tract were found in close apposition 
to serotonergic cell bodies as well as primary dendrites within and just dorsal to 
the serotonergic neurons within the DRVL/VLPAG region. Subsequent studies 
revealed that a portion of these afferent fibers arise from A2 noradrenergic neu¬ 
rons [111]. The medial nucleus of the solitary tract receives baroreceptive and 
chemoreceptive afferent fibers from the carotid sinus and aortic branch, and 
chemoreceptive and mechanoreceptive subdiaphragmatic vagal afferents from 
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the stomach, intestine, and the hepatic portal vein [112-116]. Both A2/C2 cat- 
echolaminergic neurons and non-catecholaminergic neurons in the medial nu¬ 
cleus of the solitary tract receive synaptic input from these afferents [115] and 
therefore these neurons are suited to relay information from the periphery to 
serotonergic and non-serotonergic neurons within the DRVL/VLPAG region. 

Other brain regions have projections to the DRVL/VLPAG region that over¬ 
lap with those from the medial nucleus of the solitary tract. These include the 
infralimbic cortex [117], the bed nucleus of the stria terminalis [118, 119], the 
central nucleus of the amygdala [94, 120], the median preoptic nucleus [121, 
122], the lateral and perifornical hypothalamic nuclei [69, 123, 124], the lateral 
parabrachial nucleus [15, 125, 126], and the Al, and Cl adrenergic cell groups 
[15]. Neurons within the parabrachial nucleus projecting to the DRVL/VLPAG 
region contain NT, calcitonin gene-related peptide, or galanin [127], The strong 
projections from the lateral and perifornical hypothalamic areas include large 
numbers of glutamatergic neurons [69], These connections are consistent with 
a role for the DRVL/VLPAG region in central autonomic control [128, 129], 

The DRVL/VLPAG region receives a strong, direct projection from the rat 
retina [130-132], Direct retina-raphe projections have also been described in 
cats [133] and tree shrews [134], 


Efferents 

Recent trans-synaptic viral tracing studies suggest that serotonergic neurons 
within the DRVL/VLPAG region may be part of a “sympathomotor command 
center”, regulating both the motor and autonomic components of the fight- 
or-flight response [135], Serotonin neurons, predominantly within the DRVL/ 
VLPAG region, but also a few within the DRV and DRC regions, were identi¬ 
fied as presympathetic-premotor neurons with collateral projections to both 
the adrenal gland and sympathetically denervated hindlimb muscle involved in 
the fight-or-flight response. 

The DRVL/VLPAG serotonergic neurons are notable in that, in contrast to 
serotonergic neurons in other regions of the DR, their projections appear to 
be limited to subcortical targets including visual areas such as the dorsal and 
ventral parts of the lateral geniculate body, the lateral posterior nucleus of the 
thalamus, the superior colliculus, and the retina [73, 136-138], somatosensory 
structures including the principle nucleus of the trigeminal nerve (PrV) and 
ventral posterior medial thalamus (VPM) [74], the parafascicular thalamic 
nucleus [139], the acuate/ventromedial hypothalamic region [140], the raphe 
magnus [141, 142], and autonomic structures such as the lateral hypothalamus 
[72, 143] and rostroventrolateral medulla [144, 145], Functional studies also 
support projections from the DRVL/VLPAG region to the dorsolateral peri¬ 
aqueductal gray [89, 141], Projections to both the rostral ventrolateral medulla 
and dorsolateral periaqueductal gray are consistent with a potential role in 
regulation of the autonomic and behavioral components, respectively, of the 
fight-or-flight response. 
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Functional topography 

Stimulation of the VLPAG region elicits opioid-mediated analgesia and a pas¬ 
sive emotional coping strategy including behavioral quiescence, hypotension, 
bradycardia, and hyporeactivity to environmental stimuli [90], An argument 
can be made that serotonergic neurons within the DRVL/VLPAG region par¬ 
ticipate in these responses, particularly inhibition of stress-induced autonomic 
and behavioral responses [106], Recently, we have found that in an animal model 
of anxiety and susceptibility to panic-like cardiovascular responses following 
sodium lactate infusions, serotonergic neurons were activated in rats that “did 
not” panic, but were not activated in rats that responded to sodium lactate in¬ 
fusions with panic-like tachycardia and hypertension [272], These findings are 
consistent with the hypothesis that serotonergic neurons in the DRVL/VLPAG 
region play a role in inhibitory control of cardiovascular responses associated 
with panic-like responses. 


Caudal DR 

The DRC is located within the rostral pons and extends from the rostral to the 
caudal borders of the dorsal tegmental nucleus [22], It lies directly underneath 
the cerebral aqueduct and merges with the DRI ventrally. It contains a few 
small round serotonergic neurons in its rostral part and numerous medium¬ 
sized cells [27], The medium-sized cells in the midline have short, thick den¬ 
drites oriented dorsoventrally, while those positioned laterally adjacent to the 
aqueduct have processes extending dorsolaterally and can be followed parallel 
to the surface of the ventricle for up to 150-250 pm. 


Chemoarchitecture 

The DRC contains CCK- [146] and enkephalin-producing [147] neurons as well 
as neurons immunoreactive to galanin, NT and vasoactive intestinal polypep¬ 
tide (VIP) (Tab. 2). In addition the DRC contains fibers immunoreactive to 
calcitonin gene-related peptide (CGRP), CCK, dynorphin B, neuropeptide Y 
(NPY), somatostatin (SST), and substance P [148], 


Afferent s 

In general, the DRC receives fewer afferent inputs relative to other subdivisions 
of the DR studied [69], Nevertheless, strong projections arise from the medial 
prefrontal cortex, lateral habenular nuclei, and interpeduncular nucleus, mod¬ 
erate projections arise from the preoptic area, perifornical hypothalamic area, 
and laterodorsal tegmental nuclei, and weak projections arise from the lateral 
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hypothalamic area, arcuate nuclei, substantia nigra, prepositus hypoglossal 
nucleus, and area postrema [69], 


Efferents 

The dorsal part of the DRC near the cerebral aqueduct is the principal location 
of the serotonergic neurons projecting to the ependymal lining of the ventricu¬ 
lar system and the lumens of the ventricles themselves, including the lateral 
[149, 150], third [149, 150], and fourth ventricles [149], There are a few epen¬ 
dymal-projecting cells located more rostrally in the DRD and DRV regions of 
the mid-rostrocaudal DR, and occasional cells in the MnR, but these cells are 
never found in the rostral DR. In addition to the DRI and MnR, the DRC, 
particularly its midline portion, gives rise to a projection to the hippocampus 
[20, 50, 59, 151-156], The DRC also sends dense projections to the paratenial, 
paraventricular, and lateral parafascicular thalamic nuclei as well as other mid¬ 
line and intralaminar thalamic nuclei [157], 


Functional topography 

The function of serotonergic projections to the ependymal layer and lumen of 
the ventricular system is unclear but could include modulation of ciliary move¬ 
ment, transependymal permeability, or ependymal secretion [158], Indeed, 
ependymal cells express a number of serotonin receptors [159], Application of 
serotonin to ependymal cells in cultured rat brainstem slices increases ciliary 
beat frequency [160] and glycogen metabolism [159], As was the case with the 
DRD, anxiogenic drugs, including FG-7142, mCPP, and caffeine, the anxiety- 
related neuropeptide urocortin 2 (Ucn 2), as well as social defeat, activate se¬ 
rotonergic neurons in the DRC [18, 84, 96-98], It is unclear if the ependymal- 
projecting serotonergic neurons are among those in the DRC affected by these 
stimuli. 


Interfascicular part of the DR 

The DRI is an enigmatic subdivision of the midbrain raphe complex that has 
not been extensively studied. The DRI has previously been associated with 
either the DR or the MnR [22, 23], In a mid-sagittal section it is evident that it 
contains a dense cluster of serotonergic neurons (Fig. 1). These cells are con¬ 
tinuous with a subpopulation of tightly packed serotonergic neurons within the 
dorsal part of the MnR. The serotonergic neurons in the DRI and the dorsal 
part of the MnR are bordered by the rhabdoid nucleus from the level of the 
DRI through the MnR to the apical subnucleus of the interpeduncular nucleus 
[22], Until recently, the DRI was not widely recognized as a distinct part of the 
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brainstem raphe complex in mammalian brain. The DRI region has been classi¬ 
fied as the intrafascicular region of the dorsal raphe nucleus (B7) by Dahlstrom 
and Fuxe [21,161], the nucleus centralis superior by Baxter and Olszewski [162] 
and Rasmussen et al. [2], the pars dorsalis of the superior central nucleus [163], 
the nucleus annularis by Sakai and Crochet [9], and the interfascicular nucleus 
by Azmitia [163], Azmitia and Gannon [164], Zhou and Azmitia [165], Paxinos 
and Watson [22] and Paxinos and Franklin [166], Serotonergic neurons within 
this interfascicular region (located between the medial longitudinal fasciculi) 
are morphologically distinct from serotonergic cells located more dorsally in 
the DR; cells within the DRI are spindle shaped and oriented in a vertical plane 
[163], There is developmental and morphological evidence for the DRI being 
more closely related to the MnR (with both structures located in the rostral 
pons; Fig. 1) than to subdivisions of the DR (predominantly located in the 
midbrain, Fig. 1) [23]. 


Chemoavchitectuve 

Because the DRI has only recently been widely described as a specific subdivi¬ 
sion of the DR, there is a paucity of information relevant to the chemoarchi- 
tecture of this region. It is proposed that GABA [167] and enkephalin [147] are 
co-localized with serotonin in the DRI. 


Affevents 

To our knowledge, no studies have been conducted with retrograde tracer injec¬ 
tions into the DRI region. This is an important objective for future studies. 


Efferents 

The DRI makes a contribution to the innervation of the dorsal and ventral 
hippocampus [20, 50, 59, 151-156, 168], the medial septum [50, 169], and 
entorhinal cortex in rats [59], The DRI also appears to contribute to the in¬ 
nervation of several additional cortical structures, including cortical Areas 17 
and 18a/b [63, 73] and the barrel field cortex [74], Studies in rhesus monkeys 
have revealed that DRI neurons contribute to the innervation of the frontal 
pole, dorsolateral prefrontal cortex, medial orbital cortex, inferior convexity, 
and anterior cingulate cortex [170], DRI neurons also project to the mediodor- 
sal thalamic nucleus [157, 171, 172], a major source of innervation for these 
prefrontocortical fields, suggesting that, similar to other subsets of serotonergic 
neurons, DRI neurons may give rise to collateral projections to multiple func¬ 
tionally related targets. 
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Functional topography 

Recently, we found that peripheral immune activation selectively induced c-Fos 
expression in DRI serotonergic neurons and increased serotonin concentrations 
and metabolism in the medial prefrontal cortex of mice [173,174], These effects 
on DRI serotonergic systems were associated with antidepressant-like behav¬ 
ioral effects in the forced swim test [173], Together, these data suggest that DRI 
serotonergic neurons may play a role in the regulation of emotional behavior. 
Interestingly, DRI neurons as defined above project to many of the forebrain 
structures that have been implicated in the pathophysiology of major depres¬ 
sion [175, 176], 


The median raphe nucleus 

The MnR is a distinct nucleus in the rostral pons, bordered on both sides by 
the PnO. It merges rostrally with the IPA and caudally with the DRI and PnR. 
Serotonergic neurons in the MnR are typically either small ellipsoid or me¬ 
dium-sized fusiform cells, mainly in the medial or lateral part of the nucleus, 
respectively [27], Dendrites of these cells are generally oriented in a rostrocau- 
dal direction [27], 


Chemoarchitecture 

The MnR is innervated by each of the major monoaminergic neurotransmit¬ 
ters, including serotonin [177, 178], dopamine [179], noradrenaline [177], and 
adrenaline [180, 181]. In addition, the MnR is innervated by a number of pep¬ 
tidergic fibers including (3-lipotropin [182], leu-enkephalin [183, 184], lutein¬ 
izing hormone-releasing hormone (LHRH) [185], met-enkephalin [184, 186, 
187], NT [188], oxytocin [189, 190], substance P [191], vasopressin [189, 190], 
and YIP [192-194], As in the DR, serotonergic neurons in the MnR express 
NADPH diaphorase activity [38], 


Afferent s 

Afferents to the MnR are discussed in the chapter by Vertes/Linley. 


Efferents 

Anterograde and retrograde tracing studies in rats and cats reveal that the 
MnR, together with the DRI and the DRC, is the main source of serotonergic 
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afferents to the septohippocampal system. [20, 50, 59, 151-156], These projec¬ 
tions are topographically organized. Anterograde tracing studies reveal that the 
projections from the MnR appear to target specific domains within the septo¬ 
hippocampal system, including the medial septum-vertical limb of the diago¬ 
nal band nucleus (MS/DBv), lateral parts of the lateral septum, the stratum 
lacunosum-molecular of Ammon’s horn, and the granule cell layer and adja¬ 
cent inner molecular layer of the dentate gyrus [155], Approximately 8-12% 
of MnR cells project, via collateral fibers, to both the MS/DBv and the hip¬ 
pocampus [155], A separate study reported that all MnR cells with collateral 
projections to the septum and hippocampal formation were serotonergic [195], 
Serotonergic cells projecting to the septum appear to be predominantly located 
in the rostral MnR [50], The MnR also projects to the medial entorhinal cor¬ 
tex and these cells, many of which are serotonergic, are predominantly in the 
compact or dorsal region of the MnR [59], As predicted from these anatomical 
data, stimulation of the MnR increases serotonin release in the septum, dorsal 
hippocampus, and ventral hippocampus [196], while lesions of the MnR de¬ 
crease tryptophan hydroxylase activity or serotonin content in the septum and 
hippocampus, but not in the striatum or thalamus [197, 198], 


Functional topography 

Injections of the 5-HT 1A receptor agonists 8-OH-DPAT or buspirone, or pro¬ 
caine hydrochloride into the MnR induce hippocampal theta rhythm in rats 
[199], suggesting that serotonergic neurons in the MnR normally suppress 
theta or are involved in regulation of hipppocampal desynchronization. Sev¬ 
eral lines of evidence suggest that the hippocampal theta rhythm is important 
in memory processing functions of the hippocampus (reviewed in [200]). It has 
been proposed that serotonin arising from the MnR may play a role in suppres¬ 
sion of long-term potentiation and memory processing [200], McKenna and 
Vertes [169] proposed that the MnR “may be an important part of a system of 
connections that directs the hippocampus to essentially disregard insignificant 
environmental events.” Other studies are consistent with the hypothesis that the 
MnR plays a role in dampening behavioral responsivity. For example, lesions 
of the MnR lead to facilitation of startle responses [201], These studies are 
consistent with previous suggestions that the MnR serotonergic system may 
play a role in resistance, tolerance, or “coping” with stressful events [202-204], 
The effects of MnR activity on hippocampal EEG are coincident with effects 
on locomotion [205-210], MnR stimulation decreases locomotion [211, 212], 
while inhibition of MnR activity increases it [205-208, 213-216], McKenna 
and Vertes [169] have proposed that MnR regulation of theta and locomo¬ 
tion may be coupled to allow enhanced information processing while moving 
through the environment. 
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Ascending fiber tracts arising from the midbrain 
and pontine raphe complex 


The midbrain and pontine raphe complex gives rise to at least six different as¬ 
cending serotonergic tracts innervating forebrain structures [19, 20] (Fig. 3). It 
is likely that some of these correspond to the topographically organized groups 
of serotonergic cells described above. Here we describe each of these ascending 
serotonergic tracts and attempt to associate them with topographically orga¬ 
nized groups of serotonergic neurons. 


Dorsal raphe forebrain tract 

The dorsal raphe forebrain tract (DRFT) innervates the basal ganglia, amyg¬ 
dala, and, via the tuberculohypothalamic tract, the olfactory tubercles [19]. The 
amygdaloid nuclei are almost exclusively innervated by the DRFT [19]. Specific 
targets include nucleus accumbens, the central, medial, and cortical amygda¬ 
loid nuclei, and the basolateral amygdaloid complex. The DRFT has two in¬ 
puts to the septohippocampal system, one via the septohypothalamic tract to 
the lateral septum, and another via the ansa lenticularis and perforant path to 
the hippocampus. A projection to the medial prefrontal cortex can be inferred 
based on the fact that a subset of serotonergic neurons innervating the nucleus 
accumbens also innervate the medial prefrontal cortex [91], an inference that 
is supported by anterograde tracing studies from the DR [217], A principal 
source of serotonergic neurons that form the DRFT is the mid-rostrocaudal 
DRD region [18]. 

Several lines of evidence suggest that serotonergic neurons within the DRD giv¬ 
ing rise to the DRFT may be selectively activated by anxiety- or stress-related 
stimuli. As mentioned above, anxiogenic drugs, including FG-7142, mCPP, and 
caffeine, the anxiety-related neuropeptide urocortin 2 (Ucn 2), as well as social 
defeat, all activate serotonergic neurons predominantly in the mid-rostrocaudal 
DRD region [18, 84, 96-98], a region that gives rise to the DRFT and projects 
to forebrain structures mediating anxiety-like behavioral responses (Tab. 3). 
Similar studies combining retrograde tracing methods with immediate-early 
gene expression following exposure to anxiety- or stress-related stimuli should 
help to characterize the role of the DRD and DRFT in regulating anxiety- and 
stress-related responses. 


Median raphe forebrain tract 

The median raphe forebrain tract (MRFT) innervates the septohippocampal 
system, medial prefrontal cortex, and cingulate cortex [19, 170], There are two 
separate pathways through which the MRFT innervates the hippocampus, one 
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Fig. 3 Ascending pathways from the brainstem raphe nuclei as described by Azmitia and 
Segal [19, 20], Two ascending fiber tracts travel within the medial forebrain bundle, (a) 
the dorsal raphe forebrain bundle tract (DRFT), traveling within the ventrolateral part 
of the medial forebrain bundle to the basal ganglia, amygdala, and piriform cortex; (b) 
median raphe forebrain bundle tract (MRFT), traveling within the ventromedial part of 
the medial forebrain bundle to the prefrontal cortex, cingulate cortex, medial septum, 
and hippocampus. Four additional fiber tracts are located outside the medial forebrain 
bundle, (c) dorsal raphe cortical tract (DRCT), traveling ventrolateral to the medial 
longitudinal fasciculus to the caudate putamen and parieto-temporal cortex; (d) dorsal 
raphe periventricular tract (DRPT), traveling immediately below the midbrain aque¬ 
duct to the periventricular thalamus and hypothalamus; (e) dorsal raphe arcuate tract 
(DRAT), traveling through the ventrolateral edge of the midbrain to the ventrolateral 
geniculate body nuclei and the suprachiasmatic nuclei; (f) raphe medial tract (RMT), 
traveling from the dorsal and median raphe nuclei ventrally between the fasciculi retro- 
flexus to the interpeduncular nucleus and midline mammillary nuclei. Aq, cerebral aque¬ 
duct; B6, B6 serotonergic cell group, caudal extension of the dorsal raphe nucleus; B9, 
supralemniscal serotonergic cell group; CB, cerebellum; DTg, dorsal tegmental nucleus; 
III, oculomotor nucleus; IV, trochlear nucleus; L, left; MFB, medial forebrain bundle; 
R, right; scp, superior cerebellar peduncle; VTg, ventral tegmental nucleus; (from [271] 
with permission) 


traveling via the fimbria-fornix, the other traveling via the cingulum bundle 
[19], The innervation of the medial septum is via the fornix and targets the 
septofimbrial nucleus and triangular septal nucleus [19], These fibers continue 
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caudally past the septum and are believed to innervate the indusium griseum, 
fasciola cinerea and subiculum via the dorsal fornix, and the subfornical organ 
and hippocampus via the fimbria [19]. The innervation of the hippocampus 
is predominantly directed toward the stratum oriens and stratum radiatum of 
CA2-CA3 regions, with some innervation of the dentate gyrus. The second 
major pathway to the hippocampus travels via the diagonal tract to the medial 
septum, then via the cingulum bundle at the level of the corpus callosum to 
the indusium griseum and anterior cingulate cortex [19]. Based on lesion stu¬ 
dies, the latter pathway contributes to the innervation of the polymorphic area 
of the dentate gyrus, the CA1 region between the stratum radiatum and the 
stratum moleculare-lacunosum, and the dorsal part of the entorhinal cortex 
[19]. The differential innervation of the hippocampus by the DR and MnR 
is supported by findings in cats where the DR projects primarily to the dorsal 
hippocampus, while the MnR projects to nearly the entire hippocampus [218], 
Based on retrograde tracing studies, this tract arises principally from the DRI 
and MnR (Tab. 3). 


Dorsal raphe cortical tract 

The dorsal raphe cortical tract (DRCT) emerges from the raphe complex ven¬ 
trolateral to the medial longitudinal fasciculus [19]. These fibers travel dorsal to 
the medial forebrain bundle through the subthalamus (fields of Forel) and zona 
incerta to enter the internal capsule and disperse throughout the caudate puta- 
men and parieto-temporal cortex. Projections from the DR to the motor cortex 
arise predominantly from the rostral DR, particularly the DRD core region 
[63], Those projecting to the sensorimotor cortex arise predominantly from the 
rostral DR and DRV regions [63], We propose that this tract arises from the 
rostral part of the DR, the DRV, and the DRD core region (Tab. 3). 


Dorsal raphe periventricular tract 

The dorsal raphe periventricular tract (DRPT) emerges from the rostral bor¬ 
der of the DR below the cerebral aqueduct. The fibers follow a periventricu¬ 
lar path through the thalamus and hypothalamus. The DRPT innervates the 
periventricular thalamic and hypothalamic regions and possibly the subcom¬ 
missural organ [19]. Hypothalamic targets include the arcuate, periventricular, 
and median eminence regions. Based on the close association of this tract with 
the periventricular regions of the third ventricle and subcommissural organ, 
it is likely that this tract arises from serotonergic neurons in the DRC, located 
immediately below the cerebral aqueduct, that are known to project to the sub¬ 
commissural organ, periventricular region, ependymal layer and ventricular lu¬ 
men [149,150] (Tab. 3). 
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Table 3 Ascending serotonergic fiber tracts from the midbrain/pontine raphe complex 
according to Azmitia [19], and major sources of these tracts. 


Tract 

Target structures 

Major sources 

Medial forebrain 

bundle 



Dorsal raphe 
forebrain tract 
(ventrolateral 
bundle) 

Habenular nuclei, midline and intralaminar tha¬ 
lamic nuclei, dorsal hypothalamic area, basal ganglia 
(globus pallidus), amygdala, bed nucleus of the stria 
terminalis, nucleus accumbens, entorhinal cortex, 
hippocampus (molecular layer of the dentate gyrus), 
piriform cortex, medial prefrontal cortex, olfactory 
tubercles 

Mid-rostrocau- 

dal DRD (shell 

region) [16,18, 

31, 59, 84, 85, 91, 
94,256-260] 

Median raphe 
forebrain tract 
(ventromedial 
bundle) 

Septum, hippocampus, habenular nuclei, midline and 
intralaminar thalamic nuclei, medial preoptic area, 
paraventricular hypothalamic nuclei, suprachiasmatic 
nuclei, anteromedial caudate putamen, olfactory bulb 
and anterior olfactory nuclei, medial prefrontal cor¬ 
tex, frontal, cingulate, and entorhinal cortices 

DRI/MnR [50, 

59, 72, 151, 163, 
169, 170, 195, 

196, 260-268] 

Non-medial fore¬ 
brain bundle 



Dorsal raphe 
cortical tract 

Interstitial nucleus of Cajal, subthalamus (nucleus of 
the fields of Forel), basal ganglia (caudate putamen), 
parieto-temporal cortex 

Rostral DR, 

DRV, DRD (core 
region) [16, 56, 

57, 61, 63,269] 

Dorsal raphe peri¬ 
ventricular tract 

Periventricular thalamic and hypothalamic regions, 
subcommissural organ 

DRC [149, 150] 

Dorsal raphe 

arcuate tract 

Substantia nigra, ventrolateral geniculate, and supra¬ 
chiasmatic nucleus 

DRVL/VLPAG 

[73,136-138] 

Raphe medial 

Interpeduncular nucleus, mammillary body 

IPA, MnR, 

DRVL/VLPAG 

[29, 221,222, 

270] 


Dorsal raphe arcuate tract 

The dorsal raphe arcuate tract (DRAT) extends laterally through the midbrain 
tegmentum to the lateral border of the brainstem [19], The fibers innervate the 
zona compacta of the substantia nigra, ventrolateral geniculate body, and, via 
the supraoptic commissure of Meynert, the suprachiasmatic nuclei [19], To 





Anatomy of the midbrain raphe complex 


51 


enter the suprachiasmatic nuclei, the fibers ascend rostroventrally between the 
crus cerebri and the optic tract, entering the suprachiasmatic nuclei where the 
optic fibers cross in the optic chiasm. We propose that this is the tract used by 
DRYL/VLPAG serotonergic neurons to innervate the retina [138] and used by 
the reciprocal projections from the retina to the DRVL/VLPAG serotonergic 
cell group [130, 131, 132] (Tab. 3). Azmitia [19] proposed that the circuits in¬ 
volving the ventrolateral geniculate and suprachiasmatic nucleus may be in¬ 
volved in modulation of diurnal rhythms of corticosterone secretion [219, 220] 
and sleep-wake cycles [221], 

Although Azmitia focused on ascending projections, it is also likely, as out¬ 
lined above, that the DRVL/VLPAG serotonergic neurons innervate other sub¬ 
cortical structures, including other visual areas such as the superior colliculus 
[73,136,137], auditory areas such as the cochlear nucleus and inferior colliculus 
[222], somatosensory structures including the principle nucleus of the trigemi¬ 
nal nerve (PrV) and ventral posterior medial thalamus (VPM) [74], and auto¬ 
nomic structures such as the lateral hypothalamus [143] and rostroventrolateral 
medulla [144, 145], Functional studies also support projections from the DRD 
and DRVL/VLPAG region to the dorsolateral periaqueductal gray [223], 


Raphe medial tract 

The raphe medial tract (RMT) is composed of fibers arising from both the 
DR and MnR and ascends medial to the fasciculus retroflexus at the level of 
the IPN [19]. Fibers within the RMT innervate the IPN and mammillary body. 
Large injections of horseradish peroxidase in the IPN retrogradely label neu¬ 
rons throughout the rostrocaudal extent of the MnR and also the DR [224], 
There is a high degree of topographical specificity, however. The caudal part 
of the MnR projects preferentially to the rostral subnucleus, but more rostral 
parts of the MnR project massively to all parts of the IPN excluding the ros¬ 
tral and lateral subnuclei [29, 225], In contrast, the DRVL/VLPAG region has 
a complementary projection pattern, projecting strongly to the rostral lateral, 
dorsal lateral, and dorsal medial subnuclei [29, 225], 


Intra-raphe interactions 

An important component of the neural connections of serotonergic neurons 
within the raphe complex is the connection with other parts of the raphe com¬ 
plex (intra-raphe or raphe-raphe projections). For example, the DR gives rise 
to a substantial projection to the MnR [226], Recent studies suggest that func¬ 
tional interactions may also exist from neighboring cell groups within a single 
raphe nucleus. Retrograde tracing studies using small injections of cholera 
toxin b subunit into the DRV retrogradely label neurons within the DRVL/VL- 
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PAG region (see Fig. lb in [14]). Selective lesion of serotonergic neurons in the 
DRVL/VLPAG region following injections of 5,7-dihydroxytryptamine in the 
dorsolateral hypothalamus lead to increased tryptophan hydroxylase mRNA 
expression in neurons located within the DRV region [143], suggesting that 
DRVL/VLPAG serotonergic neurons may play a role in tonic inhibitory control 
of DRV serotonergic neurons. Raphe-raphe interactions such as these could 
be involved in regulating serotonergic systems during incompatible behavioral 
states. For example, serotonergic neurons in the DRVL/VLPAG region involved 
in passive emotional coping responses may inhibit serotonergic neurons within 
the DRV that are potentially involved, via projections to the caudate putamen 
or other targets [56], in modulation of somatic motor activity. 


Afferent regulation of dorsal and median raphe nuclei 
by arousal systems 


Behavioral arousal is regulated by several interacting, but anatomically distinct, 
neural systems. Anatomical studies have demonstrated projections to the mid¬ 
brain/pontine raphe complex from the major arousal systems: histaminergic 
[227, 228], hypocretin/orexin [229-231], noradrenergic [232], CRF [233], and 
cholinergic systems [234, 235], In most cases, projections from arousal systems 
reach both dorsal and median raphe nuclei, but histaminergic and noradren¬ 
ergic systems project primarily to the DR [227, 228, 236], and the cholinergic 
system projects strongly to the MnR [234,235], Very few studies have examined 
projections of arousal systems to specific subdivisions of the DR. Presumed 
noradrenergic neurons from the locus coeruleus project to DRD, DRVL, DRC 
and DRI [232], and orexin receptor mRNA has been detected in the DRD, 
DRV, and DRI, as well as in the MnR [237], Functional studies examining the 
effects of mediators of arousal on raphe neuronal activity have focused primar¬ 
ily on the DR. Noradrenaline, histamine, and hypocretin/orexin depolarize and 
increase the firing rates of DR serotonergic neurons [238, 239], For histamine 
and noradrenaline, this is consistent with the finding that the decrease of neuro¬ 
nal firing during paradoxical sleep can be prevented by application of histamine 
or phenylephrine, and that these effects are mediated by H, and a, adrenergic 
receptors, respectively [9, 240], This effect is not observed following blockade 
of GABA a receptors [9, 240], consistent with the hypothesis that the decrease 
of serotonergic neuronal firing during paradoxical sleep is due to withdrawal 
of stimulatory input, rather than facilitation of GABA-mediated inhibition. 
Release of acetylcholine from neurons in the laterodorsal and pedunculopon- 
tine tegmental nuclei appears to be involved in the initiation and maintenance 
of paradoxical sleep [241], a time when Type I serotonergic neurons cease firing 
[9], As would be expected, iontophoretic application of acetylcholine inhibits 
presumed serotonergic neurons in the DR [242], 
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In summary, data support a tremendous diversity in the morphological, neu¬ 
rochemical, electrophysiological, hodological, and functional properties of se¬ 
rotonergic neurons within the midbrain and pontine raphe complex. Subsets 
of serotonergic neurons with unique morphological, electrophysiological, ana¬ 
tomical, or functional properties appear to be topographically organized within 
the raphe complex, although in many cases these subsets do not conform to 
classic divisions of the DR and MnR based on cytoarchitectonic grounds. We 
highlight for the first time that the six major ascending serotonergic tracts in¬ 
nervating the forebrain may arise from six different topographically organized 
subregions of the raphe complex. If this is supported by further studies, it may 
provide a hypothetical framework for understanding the input-output relation¬ 
ships and functional properties of different, anatomically defined serotonergic 
systems. 
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Abstract 

It is well established that the brainstem contains discrete groups of serotonin-containing 
neurons with extensive axonal processes that distribute throughout the neuroaxis. Sero¬ 
tonergic neurons have been implicated in a range of functions prominently including the 
modulation of various events and states of sleep. We describe the efferent and afferent pro¬ 
jections of the dorsal raphe (DR) and the median raphe (MR) nuclei. DR fibers distribute 
widely throughout the forebrain to dopamine-containing nuclei of the ventral midbrain, 
the lateral hypothalamus, the midline thalamus, amygdala, the dorsal and ventral stria¬ 
tum and adjoining regions of the basal forebrain, and most of the cortex. In contrast to 
the DR, the MR is a midline/paramidline system of projections. Specifically, MR fibers 
mainly distribute to forebrain structures lying on or close to the midline including the 
medial mammillary and supramammillary nuclei, posterior and perifornical nuclei of hy¬ 
pothalamus, midline and intralaminar nuclei of thalamus, lateral habenula, medial zona 
incerta, diagonal band nuclei, septum and hippocampus. Overall, MR projections to the 
cortex are light. With few exceptions, DR and MR project to separate, non-overlapping 
regions of the forebrain - or, in effect, DR and MR share the serotonergic innervation of 
the forebrain. Although their outputs are distinct, DR and MR receive common sets of 
afferent projections from “limbic” cortices, the medial and lateral preoptic areas, lateral 
habenula, the perifornical, lateral and dorsomedial nuclei of hypothalamus, and several 
brainstem nuclei prominently including the midbrain and pontine central gray, locus coe- 
ruleus, laterodorsal tegmental nucleus and caudal raphe groups. In addition to common 
afferents, DR receives significant projections from bed nucleus of stria terminalis, lateral 
septum, diagonal band nuclei, substantia nigra and the tuberomammillary nucleus, while 
MR receives distinct projections from the medial septum, mammillary nuclei and the in¬ 
terpeduncular nucleus. There are few projections from the amygdala to either DR or MR. 
In effect, the DR and MR are positioned to integrate of vast array of information from 
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the brainstem and limbic forebrain and through their extensive axonal network influence 
virtually all parts of the neuroaxis. 


Introduction 

The brainstem contains discrete groups of serotonin-containing (5-hydroxy- 
tryptamine, 5-HT) neurons, extending from the caudal medulla to the rostral 
midbrain. It is further conclusively documented that the axonal processes of 
these cells are extensive, distributing to structures throughout the neuroaxis. As 
would be expected from this widespread distribution and influence, 5-HT cells 
participate in a range of functions, prominently including the modulation of 
events and states of sleep [1,2]. 

In their original report in the rat, Dahlstrom and Fuxe [3] identified nine 
serotonin containing cell groups of the brainstem, which they termed B1-B9. 
With the exception of B9, these 5-HT-containing nuclei were located on the 
midline, and as such, were designated raphe nuclei; raphe meaning seam, or in 
this context, the line of junction (midline) of the two halves of the brainstem. 
With the possible exclusion of B9, the alpha-numerical designations for the 
raphe nuclei have replaced by names that reflect their anatomical location or 
characteristics such as Bl, raphe pallidus; B2; raphe obscurus; B3, raphe mag- 
nus; B5, raphe pontis; B7, dorsal raphe nucleus (DR), and B8, median raphe 
nucleus (MR) [4, 5], 

In addition to these raphe groups, newly developed histochemical proce¬ 
dures [6, 7] have revealed the presence of relatively significant numbers of 5-HT 
neurons lateral to the midline within the medulla and pons/midbrain. Those 
of the medulla primarily extend laterally from nucleus raphe magnus ventrally 
within the rostral medulla, while 5-HT cells of the pons/midbrain (outside of 
B9) stretch laterally from the DR across the dorsal pontine tegmentum, as well 
as diffusely populate the pontomesencephalic reticular formation (RF) [7], 
For the most part, caudal raphe nuclei (Bl, B2, B3) give rise to descending 
projections to the lower brainstem and spinal cord, while rostral raphe nuclei, 
particularly DR and MR, project widely throughout the upper brainstem and 
forebrain [1, 8-12], Here we review the efferent and afferent projections of the 
DR and MR. 


Serotonergic neurons of the DR and MR 

The DR and MR are densely populated with serotonergic neurons - the DR 
more so than the MR. At the midbrain, 5-HT cells of DR are fairly concen¬ 
trated along the midline, whereas further caudally they remain densely packed 
medially, but also extend laterally from the core of DR to its lateral “wings” 
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(Fig. 1). Serotonergic cells of DR are typically large (30-40 pm), fusiform in 
shape, stain darkly for 5-HT and contain about four to five primary dendrites 
radiating from the cell body. 



Fig. 1 Light-field photomicrograph of a transverse section through the upper brainstem 
showing 5-HT immunostained cells in the dorsal raphe nucleus (DR) (including the late¬ 
ral wings of DR), the median raphe nucleus (MR) and the supralemniscal nucleus (B9). 
AQ, cerebral aqueduct; ml, medial lemniscus; RPO, nucleus pontis oralis 


72 


Robert P. Vertes and Stephanie B. Linley 


By comparison with the DR, there are considerably fewer 5-HT containing 
neurons in the MR. As shown in Fig. 1, serotonergic MR cells are fairly evenly 
dispersed throughout the nucleus. Those located dorsally in MR are predomi¬ 
nantly small (10-12 pm), oval, and stain lightly for 5-HT, whereas 5-HT cells 
of the ventral MR are medium sized (15-22 pm) and either oval or spindle 
shaped. The dendrites of the oval cells are short (10-20 pm), and coarse, while 
those of the spindle-shaped neurons are generally long (40-150 pm). 

Surprisingly, despite the degree of interest in 5-HT systems, few studies 
have quantified numbers of 5-HT cells in raphe nuclei. Early studies estimated 
the number of 5-HT cells in the MR to be -1100 [13] and in the DR to be 
-11 500 cells [14], More recently, we reported the following values: 5-HT cells 
in DR = 15 191; in MR = 4114; in the supralemniscal nucleus (or B9) = 4571 
and in the pontomesencephalic reticular formation = 1948 [7], As is evident, 
the DR is the major 5-HT-containing cell group of the brain. 


Ascending projections of the dorsal raphe nucleus 

DR fibers distribute widely throughout the neuroaxis [1,4, 5], With some dif¬ 
ferences among reports, several early studies, using older tracing techniques, 
showed that DR strongly targeted several forebrain sites including the lateral 
hypothalamus, the midline and intralaminar nuclei of thalamus, parts of the 
amygdala, the dorsal and ventral striatum, the septum, and much of the cor¬ 
tical mantle [15, 16], In more recent examinations of DR projections to the 
brainstem [17] and forebrain [9], using the anterograde tracer Phaseolus vul¬ 
garis leukoagglutinin (PHA-L), we have confirmed some earlier findings and 
described several additional ones, as follows. 


DR projections to the forebrain 

DR fibers distribute widely throughout the forebrain. The main subcortical 
targets are the midbrain/diencephalic central gray, the ventral tegmental area 
(VTA), substantia nigra-pars compacta (SNc), the lateral (LHy) and supra- 
mammillary (SUM) nuclei of hypothalamus; the anterior (anteroventral and 
anteromedial), lateral (lateral dorsal and lateral posterior), mediodorsal, mid¬ 
line and intralaminar, and lateral geniculate nuclei (LGN) of the thalamus, the 
central, lateral, basolateral, basomedial and amygdalo-piriform transition zone 
of amygdala; and the nucleus accumbens (ACC), dorsal striatum (caudate-pu- 
tamen, CP), bed nucleus of stria terminalis (BST), lateral septum (LS), lateral 
preoptic area (LPO), substantia innominata (SI), magnocellular preoptic area 
(MgPO), ventral pallidum (VP), endopiriform nucleus (EN) and claustrum 
(CLA) of the basal forebrain [9, 18], 
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The main cortical targets of DR are the entorhinal (EC), piriform, agranu¬ 
lar insular (dorsal, ventral and posterior divisions), lateral agranular (frontal) 
cortex, medial orbital (MO) and the medial prefrontal cortex (mPFC), which 
includes the medial agranular (AGm), anterior cingulate (AC), prelimbic (PL) 
and infralimbic (IL) cortices [8]. DR distributes moderately to the hippocam¬ 
pal formation (HF). 


DR projections to the dopaminergic system: projections to dopaminergic 
cells and to their sites of termination 

Serotonergic systems interact with and influence dopaminergic (DA) systems 
of the forebrain [13, 19]. As described, DR fibers distribute to the midbrain 
tegmentum, terminating strongly in DA cell groups, VTA and SNc. In a com¬ 
plementary manner, DR projects to the main targets of VTA and SNc; namely, 
to the basal nuclei of amygdala, the dorsal and ventral (nucleus accumbens) 
striatum, BST and widely throughout the frontal cortex to the agranular insu¬ 
lar, mPFC, and orbital cortices. In effect, DR is positioned to influence the ori¬ 
gins and terminal destinations of the nigrostriatal (from SNc) and mesolimbic 
(from VTA) systems. 


DR projections to the thalamus 

The primary targets of DR fibers to the thalamus are anteromedial and antero- 
ventral groups of the anterior thalamus, the lateral dorsal nucleus, LGN com¬ 
plex and the midline and intralaminar nuclei of thalamus [9, 10, 20-23], The 
midline (and intralaminar) nuclei of thalamus are extensively interconnected 
with the limbic forebrain [24-26] and hence designated the “limbic thalamus” 
[27, 28], For instance, the nucleus reuniens (RE) of the midline thalamus is 
strongly reciprocally linked with hippocampus and mPFC [21, 24-26, 29-32], 
and receives pronounced afferents from the brainstem [26,27] and from arousal- 
related sites of the hypothalamus [35, 36], This has lead to the proposal that RE 
(and other nuclei of the midline thalamus) serve a critical role in arousal and 
attention [29, 38]. DR projections to the midline thalamus may participate in 
these functions. 


DR projections to the basal forebrain 

DR fibers distribute widely over the basal forebrain (BF) to BST, LS, the dor¬ 
sal and ventral striatum and along the floor of the basal forebrain to SI, VP, 
and LPO [9, 10, 18]. Fig. 2 shows dense terminal labeling rostrally (Fig. 2a) 
and caudally (Fig. 2b) within BST, above and below the anterior commissure, 
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produced by a caudal DR injection [9], As discussed below in greater detail, 
DR and MR project in a complimentary manner to the septum; that is, MR 
distributes to the medial septum and lateral part of lateral septum (LS), while 
DR projects to the intermediate zone of LS - or the region of the septum not 
served by MR. This is depicted in Fig. 3: DR fibers to septum terminate within 
a restricted dorsomedially to ventromedially oriented strip of LS that includes 
parts of the dorsal, intermediate and ventral LS. 

DR projects substantially to regions of the BF known to contain dense pop¬ 
ulations of acetylcholine (ACh)-containing neurons: MgPO, SI and VP [18, 
33-36], ACh-containing cells of BF distribute widely throughout the cortex 
[37-39] and reportedly serve an important in role in behavioral/EEG arousal 
[36, 40-42], DR projections to these sites (as well as to the cortex) would ap¬ 
pear to modulate processes of arousal/attention. 



Fig. 2 (a,b) Low-magnification dark-field photomicrographs though the basal forebrain 
showing labeling at rostral (a) and caudal (b) levels of the bed of the nucleus stria 
terminalis (BST), dorsally and ventrally bordering the anterior commissure, (c) High- 
magnification photomicrograph of BST labeling depicted in (a). Labeling produced by 
an injection into the caudal DR. Scale for (a,b): 500 pm; (c): 200 pm. Reprinted from 
Vertes [9] 
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DR projections to the cortex 

Outside of motor areas of the frontal cortex, the foremost targets of DR fibers 
are parts of “limbic cortices” including the medial orbital, agranular insular, 
piriform, mPFC (AC, PL, IL) and entorhinal cortices. DR distributes much 
less abundantly to associational, somatosensory, and special sensory (e.g., vi¬ 
sual, auditory) areas of cortex. This parallels the general lack of DR projec¬ 
tions to somatomotor regions of the thalamus. The pervasive and widespread 
DR innervation of “limbic cortices” is consistent with a role for serotonergic 
systems in global actions on the forebrain including marked effects on affect 
and mood [43], 



Fig. 3 (a,b) Low-magnification dark-field photomicrographs of transverse sections 
through the rostral forebrain showing labeling rostrally (a) and caudally (b) within the 
lateral septal nucleus, (c) High-magnification dark-field photomicrograph of lateral sep¬ 
tal labeling depicted on the left side of (a). Labeling produced by an injection in caudal 
lateral ventricle; LSd, lateral septum, dorsal division; LSi, lateral septum, intermedi¬ 
ate division; LSv, lateral septum, ventral division; MS, medial septum. Scale for (a,b): 
500 pm; (c): 200 pm. Reprinted from Vertes [9] 
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Comparisons of projections from the rostral and caudal DR 

Although rostral and caudal DR projections overlap, there are some impor¬ 
tant differences [9], Perhaps the most notable is that the caudal, compared to 
the rostral, DR distributes much more heavily to the parts of the medial basal 
forebrain, the lateral septum (see Fig. 3) and the hippocampus. The rostral DR, 
on the other hand, is the source of considerably stronger overall projections to 
the forebrain, particularly dense to the amygdala, lateral basal forebrain and 
regions of the cortex. 


DR projections to the brainstem 

Serotonergic (or DR) systems have been shown to influence several brainstem- 
mediated functions. They include (but are not limited to): (1) a permissive (or 
disinhibitory) role in the generation of ponto-geniculo-occipital (PGO) spikes 
of REM sleep, and possibly the state of REM sleep [44-46]; (2) analgesic (or 
anti-nociceptive) effects via projections to cell groups of the ventromedial me¬ 
dulla [47]; (3) modulation of autonomic functions putatively via projections to 
the parabrachial nuclei [48]; and (4) sensorimotor regulatory influences through 
projections to cranial nerve nuclei [49], Despite this, early studies, using older 
tracers, described at best modest DR projections to the brainstem. 

In an examination of DR projections to the brainstem using PHA-L [17], 
we found that DR fibers distribute widely throughout the brainstem, terminat¬ 
ing significantly in sites spanning the medulla through the midbrain. The main 
targets in the midbrain/pons were the pontomesencephalic central gray, the 
midbrain reticular formation (RF), the pedunculopontine tegmental nucleus 
(PPT), the medial and lateral parabrachial nuclei, the nucleus pontis oralis 
(RPO) and pontis caudalis (RPC), the locus coeruleus (LC), the laterodorsal 
tegmental nucleus (LDT) and raphe nuclei - central linear, median raphe and 
raphe pontis. Consistent with the latter, Tischler and Morin [50] recently dem¬ 
onstrated pronounced DR to MR projections in the hamster - and strong re¬ 
ciprocal DR-MR connections. 

The main DR targets in the medulla were nucleus gigantocellularis (NGC), 
raphe magnus and obscurus, the facial nucleus, the rostral ventrolateral medul¬ 
lary area (RVL) and nucleus gigantocellularis-pars alpha (NGCa). 

As discussed in detail in other chapters of this volume, DR distributes sig¬ 
nificantly to the two ACh-containing nuclei of the upper brainstem, PPT and 
LDT. These nuclei (LDT/PPT) have been implicated in the control of various 
events of REM, prominently including PGO waves of REM sleep [2, 45, 51, 
52], DR reportedly serves a permissive role in PGO spike generation; that is, 
when active, DR cells suppress PGO spikes and when silent, release them. Rele¬ 
vant to this: (1) the discharge of DR neurons is inversely correlated with occur- 
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rence of PGO spikes; (2) serotonergic agonists suppress PGO spikes, while 5- 
HT antagonists enhance them; and (3) electrical DR stimulation inhibits PGO 
spikes [53], 


Projections of the MR 

Similar to the DR, a number of early studies using older tracers (mainly autora¬ 
diography) examined ascending projections of MR and identified some major 
terminal zones. They included parts of the medial hypothalamus and medial 
basal forebrain, medial thalamus, septum and the hippocampus [8, 16, 54], For 
instance, in an early report, we showed that MR fibers mainly ascend within the 
medial forebrain bundle (MFB) and distribute to the interpeduncular nucleus 
(IP), VTA, the medial mammillary nucleus, parts of the midline/intralaminar 
thalamus, the lateral habenula (LH), nuclei of the diagonal band, septum, nu¬ 
cleus accumbens and the hippocampus [8], In this study, MR projections to 
the brainstem and cortex were not examined. Using PHA-L, we subsequently 
examined the totality of MR projections and compared those from the rostral 
and caudal MR [11], 


MR projections to the forebrain 

As described previously [8, 15], the bulk of MR fibers ascend within the MFB 
throughout the forebrain and give off projections to various structures en route 
[11], Unlike the widespread distribution of DR fibers throughout the forebrain, 
MR fibers predominately target midline structures of the brainstem, the hypo¬ 
thalamus, thalamus and basal forebrain - as well as the hippocampus [11], In 
effect, the MR represents a midline/paramidline system of connections. The 
terminal sites in the forebrain are IP, VTA, medial mammillary nucleus, SUM, 
the posterior nucleus of the hypothalamus (PH), the dopamine cell contain¬ 
ing region (A13) of the medial zona incerta (ZI), the parafascicular, reuniens, 
mediodorsal, central medial, paracentral and central lateral nuclei of the mid¬ 
line/intralaminar thalamus, the LH, the suprachiasmatic nucleus (SCN), the 
vertical and horizontal limbs of diagonal band nuclei, the medial septum (MS) 
and the hippocampus. Overall, MR projections to the cortex are light and es¬ 
sentially restricted to the perirhinal, entorhinal (EC) and parts of the prefron¬ 
tal cortices. 

As discussed in greater detail below, DR and MR distribute very differen¬ 
tially throughout the forebrain; i.e., there are few areas of overlap in the ter¬ 
minal distribution of the two sets of projections. With respect to DA-contain- 
ing sites, DR distributes significantly to the sources (SNc and VTA) and main 
targets (CP, ACC and frontal cortices) of the nigrostriatal and mesolimbic DA 
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systems. By contrast, MR contributes some fibers to VTA, but mainly targets 
the A13 group of the medial ZI. Among their putative functions, DA cells of 
the medial ZI contribute to the release of gonadotropins; MR stimulation en¬ 
hances the secretion of gonadotropins [55, 56], 

The MR serves a well-recognized role in the control of the EEG activity 
of the hippocampus - or states of hippocampal desynchronization [57, 58], 
MR stimulation effectively desynchronizes the hippocampal EEG, or blocks 
the hippocampal theta rhythm [59, 60], In a series of studies, we and others [57, 
58, 61] have shown that the theta rhythm of the hippocampus is controlled by 
a network of cells extending from the brainstem reticular formation to the sep¬ 
tum/hippocampus, including RPO, SUM, MS, and hippocampus. Specifically, 
during theta rhythm, tonically firing cells of RPO activate neurons of SUM, 
which in turn convert this steady barrage into a rhythmical pattern of discharge 
that is relayed to “pacemaking” cells of the medial septum (MS) that act on the 
hippocampus to generate theta. In its role in blocking theta, MR could exert 
actions on any (or all) of the nodes involved in its generation: RPO, SUM, MS 
or hippocampus. MR projects strongly to each of these sites. 

MR fibers distribute profusely throughout the mediolateral extent of the 
SUM. As shown for two levels of SUM in Fig. 4, MR fibers terminate heavily 
within SUM, most densely in the medial SUM and medial aspects of the lateral 
SUM directly above the mammillo-thalamic tract. In a like manner, the sep¬ 
tum and hippocampus are major MR targets. Both DR and MR project to the 
septum, but interestingly, and reflecting their segregated distribution through¬ 
out the brain, DR and MR project to separate, non-overlapping regions of the 
septum. As described, DR fibers terminate selectively within a dorsomedially 
to ventrolaterally oriented strip of the intermediate LS. By contrast, MR fibers 
project to the medial septum and the lateral part of the lateral septum but avoid 
the intermediate LS. This is depicted in Fig. 5, which shows massive terminal 
labeling in MS and lateral LS, but an absence of fibers in the intermediate LS 
with an MR injection [11], 

Although DR and MR project to the hippocampus (HF), the projections of 
MR considerably exceed those of DR. MR fibers reach all parts of the dorsal 
and ventral HF, and terminate particularly densely in the outer molecular layer 
(stratum lacunosum-moleculare) of CA1 and CA3 of Ammon’s horn as well 
as within the inner molecular and granule cell layer of the dentate gyrus (DG). 
This is illustrated for the dorsal hippocampus in Fig. 6, which shows fibers fol¬ 
lowing the contour of stratum lacunosum-moleculare of CA1 and CA3, di¬ 
rectly above the hippocampal fissure, as well as a narrow band of fibers overlay¬ 
ing the granule cell layer of the upper and lower blades of DG. 

The massive MR projections to the septum and hippocampus suggest that 
MR may project to both sites via axon collaterals originating from a common 
group of MR cells. We recently examined this, using fluorescent retrograde tra¬ 
cers [62] and found that: (1) approximately 8-12% of MR neurons were double 
labeled (collateral projections to medial septum and hippocampus); (2) double- 
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labeled cells were predominately located in the rostral MR; and (3) consider¬ 
ably more double-labeled cells were present in MR than DR. This suggests that 
a discrete population of MR neurons (mainly of the rostral MR) may simulta¬ 
neously influence the septum and hippocampus. The functional significance of 
this is presently unclear. 



Fig. 4 Dark-field photomicrographs of transverse sections through the diencephalon 
showing patterns of labeling rostrally (a) and caudally (b) within the supramammillary 
nucleus (SUM) produced by a PHA-L injection into MR. Note strong labeling throu¬ 
ghout SUM and most pronounced in the medial SUM and medial aspects of the lateral 
SUM. 3V, third ventricle; MB, mammillary bodies; MR, median raphe; MT, mammil- 
lothalamic tract; SUM, supramammillary nucleus. Scale for (a, b): 500 pm. Reprinted 
from Vertes et al. [11] 
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Fig. 5 Dark-field photomicrograph through the rostral forebrain showing pattern of 
labeling in the medial and lateral septum produced by an injection in the median raphe 
nucleus. Note pronounced labeling in the medial septum and lateral part of the lateral 
septum (LS), but an essential absence of labeling in the medial part of the LS. AC, 
anterior commissure; CC, corpus callosum; LV, lateral ventricle. Scale bar: 500 pm. Re¬ 
printed from Vertes et al. [11] 
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Fig. 6 Dark-field photomicrograph showing patterns of labeling in the dorsal hippo¬ 
campal formation produced by an injection in the median raphe nucleus. Note the dense 
terminal labeling in the outer molecular layers of CA1-CA3 as well as in the granule cell 
layer and adjacent molecular layers of the upper and lower blades of the dentate gyrus. 
CA1, CA3, fields of Ammon’s horn; DG, dentate gyrus; so, stratum oriens of hippocam¬ 
pus. Scale bar: 500 pm. Reprinted from Vertes et al. [11] 


Comparison of ascending projections from the rostral and caudal MR 

With some exceptions, there are no major differences in patterns of projection 
from the rostral and caudal MR, with essentially only differences in relative 
densities of projections to some sites. For instance, the caudal MR distributes 
more heavily to the brainstem, the hypothalamus (particularly the mammillary 
body, SUM, and PH) and ZI, while the rostral MR is the source of stronger 
projections to the diagonal band nuclei, septum and hippocampus. The inter¬ 
peduncular nucleus, LH and thalamus receive equivalent projections from the 
caudal and rostral MR. 


MR projections to the brainstem 

The main brainstem targets of MR are LDT, pedunculopontine tegmental nu¬ 
cleus (PPT), ventromedial parts of the pontomesencephalic central gray (CG), 
LC, nucleus incertus (INC), and other raphe nuclei including DR, raphe pontis 
and raphe magnus [11], MR distributes moderately to the brainstem reticu¬ 
lar formation - medulla through midbrain. Consistent with these findings [11], 
several studies have shown that injections of retrograde tracers in DR, LDT, 
PPT, CG, INC and RF gave rise to pronounced cell labeling in MR [50, 63-66], 
As discussed, 5-HT DR projections to LDT/PPT reportedly modulate PGO 
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spikes (and possibly other events of REM). The demonstration of significant 
MR projections to LDT/PPT, together with the findings that 5-HT MR neu¬ 
rons, like those of the DR, fire at progressively lower rates from waking to slow- 
wave sleep to REM suggests that MR may participate with DR in the control 
of PGO waves [1, 2, 67, 68], 

The ventral part of CG, which is the main target of MR projections, is richly 
supplied by 5-HT fibers [69-71], Beitz et al. [64] demonstrated that approxi¬ 
mately 12% of these 5-HT fibers originate from MR and that about 50% of 
MR cells projecting to CG are serotonergic. Finally, the demonstration of sig¬ 
nificant reciprocal projections between DR and MR [8, 9, 10, 11, 50] suggests a 
possible coordination of DR-MR activity during certain conditions or states, 
possibly leading to a fairly global release of 5-HT throughout the brain under 
particular conditions. 


Differential DR and MR projections 

As may be apparent from the foregoing, with few exceptions, the DR and 
MR distribute to separate, essentially non-overlapping, sites in the forebrain. 
As described, MR is predominately (and best characterized) as midline/para- 
midline structures systems of projections (Fig. 7a). Specifically, MR fibers as¬ 
cend within the MFB and give off projections to various midline/paramidline 
structures in their ascent through the forebrain. From caudal to rostral this 
mainly includes VTA, medial mammillary and supramammillary nuclei, poste¬ 
rior and perifornical (area) nuclei of hypothalamus, midline and intralaminar 
nuclei of thalamus, FH, medial ZI, SCN, diagonal band nuclei, septum (medial 
and lateral) and hippocampus. With the exception of modest projections to the 
perirhinal and entorhinal cortices, MR sends few projections to other (lateral) 
parts of the forebrain. 

By contrast, DR fibers distribute to most of the remaining regions of the 
forebrain (not served by MR) primarily including, but not limited to, the sub¬ 
stantia nigra pars compacta, the lateral hypothalamus, the amygdala, the dor¬ 
sal striatum, BST, lateral preoptic area, substantia innominata, magnocellular 
preoptic nucleus, nucleus accumbens and most of the cortex (Fig. 7b). Essen¬ 
tially, DR and MR only project commonly to the midline and intralaminar 
thalamus (Fig. 7). In the few instances of overlapping projections, it is also 
generally the case that DR and MR distribute to separate parts of a structure/ 
nucleus. This is best exemplified by projections to the septum. MR distributes 
to medial septum and to the lateral FS, but not to the medial FS; by contrast, 
DR projects selectively to the medial FS, avoiding remaining regions of the sep¬ 
tum. Additionally, DR and MR project to separate regions of the nucleus ac¬ 
cumbens: DR to the core and MR to the shell of ACC [73-75], van Bockstaele 
and Pickel [74] showed that the morphological characteristics of terminals in 
the core were of the “DR type” and those in the shell of the “MR type” [4, 5], 
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while the selective elimination of DR fibers with p-chloroamphetamine (PCA) 
and 3, 4-methylendioxymethamphetamine (MDMA) eliminates 5-HT fibers in 
the core but not in the shell of ACC [75-77], In effect, the raphe/5-HT innerva¬ 
tion of the forebrain is shared by MR and DR. These differential projections 
undoubtedly reflect important functional differences of the two systems. 


Differential serotonergic DR and MR projections 
to the forebrain 


As indicated above, examinations of ascending DR and MR projections using 
anatomical tracers have shown that these are largely distinct systems with few 
overlapping projections to the forebrain. In line with this, 5-HT projections 
from DR and MR would seemingly show a similar degree of segregation. To 
examine this, we recently established overall patterns of distribution of 5-HT 
fibers to the forebrain in rats [78], and then compared these patterns to those 
seen following the selective elimination of 5-HT MR fibers with 5,7-dihydroxy- 
tryptamine (5,7-DHT) injections into MR, or by the selective destruction of 
5-HT DR fibers with systemic injections of PCA [76, 79-82], In the follow¬ 
ing, we describe normal patterns of 5-HT immunolabeling in the septum, hip¬ 
pocampus, dorsal striatum (caudate-putamen) and mPFC, and compare them 
with patterns of 5-HT innervation of the same structures following the selec¬ 
tive destruction of 5-HT MR or DR fibers. 

Fig. 8 shows the normal pattern of 5-HT innervation of the septum (Fig. 8a) 
and the pattern of 5-HT labeling in the septum following peripheral injections 
of PCA (Fig. 8b). As depicted in Fig. 8a, 5-HT-immunolabeled fibers fill the 
lateral and medial septum with greatest density in the MS and the vertical limb 
of the diagonal band nuclei (DBv). Following PCA injections that selectively 
destroy 5-HT DR fibers [79, 80], there is a complete loss of 5-HT axons dorso- 
ventrally throughout the lateral septum, while those of the MS and DBv (and 
the caudal pole of ACC) remain intact (Fig. 8b). This is consistent with the 
selective MR projections to the MS (see Fig. 5) and the DR projections to the 
intermediate LS (see Fig. 3). 

Fig. 9a shows the normal pattern of distribution of 5-HT fibers to the hip¬ 
pocampal formation (HF) and the pattern of 5-HT labeling in the HF following 
5,7-DHT injections into the MR (Fig. 9b). As illustrated in Fig. 9a, 5-HT fibers 
are abundantly present throughout the hippocampus, with a particularly dense 
concentration within the stratum lacunosum-moleculare (slm) of CA1, strata 
oriens, pyramidal, and radiatum of CA2/CA3 and the polymorphic layer of the 
upper blade of the dentate gyrus. As demonstrated in Fig. 9b, there was a dra¬ 
matic loss of 5-HT fibers throughout the hippocampus following a 5,7-DHT 
injection restricted to the MR. This is consistent with the demonstration that 
the HF receives its main raphe (and 5-HT) input from the MR (see Fig. 6). 
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◄ Fig. 7 (a) A medial schematic sagittal section summarizing the principal projection 
sites of the median raphe nucleus (MR). Dashed lines indicate fibers of passage, (b) A 
lateral schematic sagittal section summarizing the principal projection sites of the dorsal 
raphe nucleus (DR). Dots in (a) and (b) represent labeled cells at sites of injection in the 
median and dorsal raphe nuclei, respectively. As illustrated, MR and DR fibers project 
to non-overlapping sites in the brainstem and forebrain. Schematic sections modified 
from Paxinos and Watson [72], AC, anterior commissure; ACC, nucleus accumbens; 
AGm, medial agranular (frontal) cortex; AMYG, amygdala; AQ, aqueduct; BC, bra- 
chium conjunctivum; BST, bed nucleus of stria terminalis; C, cerebellum; CC, corpus 
callosum; CG, central gray; C-P, caudate-putamen; EC, entorhinal cortex; F, fornix; FL, 
forelimb area of cortex; HF, hippocampal formation; HL, hindlimb area of cortex; IC, 
inferior colliculus; ILr, intralaminar nuclei of the thalamus (rostral group); InC, insular 
cortex; IP, interpeduncular nucleus; LC, locus coeruleus; LDT, laterodorsal tegmental 
nucleus; LH, lateral habenula; LHy, lateral hypothalamus; LPO, lateral preoptic area; 
LV, lateral ventricle; LS, lateral septum; MD, mediodorsal nucleus of thalamus; MgPO, 
magnocellular preoptic nucleus; MS-DB, medial septum-diagonal band; NGC, nucleus 
gigantocellularis; NP, nucleus of pons; OcC, occipital cortex; OX, optic chiasm; PF, 
parafascicular nucleus of thalamus; PFo, perifornical region of hypothalamus; PH, pos¬ 
terior nucleus of hypothalamus; PiC, piriform cortex; PPT, pedunculopontine tegmental 
nucleus; PrC, perirhinal cortex; PV, paraventricular nucleus of thalamus; RE, nucleus 
reuniens of thalamus; RM, raphe magnus; RP, raphe pontis; RPC, nucleus pontis cauda- 
lis; RPO, nucleus pontis oralis; SC, superior colliculus; SI, substantia innominata; SNC, 
substantia nigra, pars compacta; SUM, supramammillary nucleus; VP, ventral pallidum; 
VTA, ventral tegmental area; ZI, zona incerta; 3V, third ventricle; 4V, fourth ventricle. 
Reprinted from Vertes et al [11] 
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Kig. 8 Light-field photomicrograph of transverse sections through the rostral forebrain 
showing distribution of 5-HT fibers with the septal region visualized with an antisera for 
the serotonin transporter protein (SERT) in (a) naive rat, and in (b) PCA-lesioned rat. 
Note a complete loss of 5-HT axons throughout the dorsal and ventral lateral septum 
(LS) in the PCA-lesioned rat, while fibers in the medial septum (MS) and nucleus of 
diagonal band vertical division (DBv) remain intact. Scale for (a, b): 500 pm 
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Fig. 9 Light-field photomicrograph of transverse sections through the dorsal hippo¬ 
campus showing distribution of 5-HT fibers within the hippocampus visualized with an 
antisera for the serotonin transporter protein in (a) naive rat, and in (b) 5,7-DHT MR- 
lesioned rat. Note the robust distribution of 5-HT fibers throughout the hippocampus in 
the naive rat (a), and a dramatic loss of 5-HT fibers following an injection of 5,7-DHT 
in MR (b). DG, dentate gyrus; LD, laterodorsal nucleus of the thalamus; slm, stratum 
lacunosum-moleculare. Scale for (a): 500 pm; (b): 625 pm 


Robert P. Vertes and Stephanie B. Linley 


Fig. 10 shows a normal pattern of 5-FIT immunolabeling in the dorsal stria¬ 
tum (CP) (Fig. 10a) and patterns observed following a systemic injection of 
PCA (Fig. 10b). As exemplified, 5-FIT fibers richly distribute throughout the 
CP, interspersed among the fascicles of the internal capsule (Fig. 10a), and are 
virtually totally eliminated with PCA injections (Fig. 10b). This indicates that 
DR is essentially the sole source of 5-FIT projections to the dorsal striatum. 

Fig. 11 shows patterns of 5-HT labeling in the prelimbic cortex (PL) of the 
mPFC before (Fig. 11a) and after peripheral PCA injections (Fig. lib). As 
demonstrated, the mPFC is richly supplied by 5-HT fibers, heavily concentrated 
in layers 1 and 5/6 (Fig. 11a) and following PCA lesions there is a dramatic, but 
not total, reduction in 5-HT fibers in the PL. This indicates that the DR is the 
major, but not the only, source of 5-HT fibers to the mPFC. 


Afferent projections to the DR 

The DR receives afferent projections from several forebrain and brainstem 
sites. Early studies examining input to DR emphasized projections from the 
habenula. For instance, Aghajanian and Wang [83] showed that the LH sends a 
dense and highly topographically organized set of projections to the DR (and 
MR), whereas projections to other midbrain and pontine sites are sparse. Sub¬ 
sequent studies have confirmed this, and described additional inputs to DR 
from the mPFC, preoptic area, BST, nuclei of the diagonal band, dorsomedial, 
perifomical and lateral hypothalamus, ventral tegmental area, substantia nigra, 
periaqueductal gray, median raphe, parabrachial nucleus, laterodorsal tegmen¬ 
tal nucleus, and nucleus of the solitary tract (NTS) [22, 83-86], 

Perhaps the most detailed account of DR afferents is the report of Peyron 
and colleagues [85], which analyzed forebrain projections to eight subdivisions 
of DR, including the lateral wings of DR. They reported that DR receives 
pronounced afferents from the prefrontal cortex (mPFC, orbital, and insular 
cortices), preoptic areas, the lateral, perifomical, dorsomedial, and posterior 
hypothalamus, medial ZI, and LH. 


Cortical projections to DR 

Cortical afferents to DR primarily originate from the “limbic cortices”; i.e., the 
orbital cortex (medial, ventral, and lateral divisions), the mPFC [infralimbic 
(IL), prelimbic, anterior cingulate (AC), and medial agranular] and the insular 
cortex. Peyron et al. [85] reported that the lateral orbital (LO) and ventral or¬ 
bital (VO) cortices send topographically organized projections to DR: LO pro¬ 
jects selectively to the ventral-central and lateral wings of DR, and VO to the 
dorsal-central and rostral DR. By comparison, the medial orbital (MO) cortex 
distributes fairly uniformly, but moderately, throughout DR - with the excep- 
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Fig. 10 Light-field photomicrographs of transverse sections through the striatum show¬ 
ing 5-HT fibers in the dorsal striatum visualized with an antisera for the serotonin trans¬ 
porter protein in (a) naive rat, and in (b) PCA-lesioned rat. Note the robust distribution 
of 5-HT fibers throughout the caudate putamen (CP) in a nave rat (a), compared to a 
virtual absence of 5-HT fibers in CP following a PCA injection (b). LV, lateral ventricle. 
Scale for (a, b): 250 pm 
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Fig. 11 Light-field photomicrograph of transverse sections through the rostral forebrain 
showing 5-HT fibers within the medial prefrontal cortex visualized with an antisera for 
the serotonin transporter protein in a naive rat (a) and in PCA-lesioned rat (b). Note 
the dense concentration of 5-HT-labeled fibers throughout the prelimbic (PL) cortex in 
a naive rat (a), and a dramatic loss of 5-HT fibers following a PCA lesion (b). fa, corpus 
callosum anterior forceps. Scale for (a, b): 250 pm 


Efferents and afferents of the dorsal and median raphe nuclei 


91 


tion of pronounced projections to the lateral wings of DR. The insular cortex, 
on the other hand, lightly targets the lateral wings, but significantly the rostral 
and central DR [85], Recent findings have confirmed pronounced agranular 
insular cortical projections to DR [87, 88], 

With respect to the mPFC, Peyron et al. [85] described prominent numbers 
of labeled neurons in a region of mPFC spanning the prelimbic (PL) and an¬ 
terior cingulate (AC) cortices (which they termed cingulate cortex) following 
retrograde injections into the rostral, central, or lateral wings of DR. Gabbott 
et al. [89] have subsequently confirmed pronounced AC to DR projections. Al¬ 
though several studies, utilizing various techniques, have shown that the in- 
fralimbic and prelimbic cortices strongly innervate DR [86, 89-94], there are 
differences among studies regarding relative density of IL and PL projections 
to DR. Most studies using retrograde tracers show stronger IL than PL pro¬ 
jections to DR, while the reverse appears true for reports using anterograde 
tracers. For instance, Peyron et al. [85] reported significant retrograde cell la¬ 
beling in IL following injections into all regions of the DR, and others using 
comparable techniques described similar findings [86, 89, 93], In a recent com¬ 
parison, however, of IL and PL projections using PHA-L, we [90] found that 
PL distributes heavily, IL modestly, to DR. Differences among studies could 
involve differing characteristics of anatomical tracers. It is clear, nonetheless, 
that the ventral mPFC (AC, .PL and IL) is the source of pronounced projec¬ 
tions to DR. 


Basal forebrain projections to DR 

Sources of basal forebrain (BF) afferents to DR include BST, medial and late¬ 
ral preoptic areas, lateral septum, ventral pallidum (VP), substantia innomi- 
nata (SI), and the claustrum (CLA) [83-86, 95-97], BST (medial, lateral, ven¬ 
tral, and anterior divisions) mainly distribute to the central DR, while other 
parts of BF (VP, SI and CLA) appear to project to all divisions of DR [85], The 
lateral septum is reciprocally linked to DR [9, 85], 

DR receives substantial input from the preoptic area [83-85, 97], The major 
sources originate from the lateral and ventrolateral preoptic areas, secondarily 
from the medial preoptic area (including the medial preoptic nucleus), and in 
a relatively minor way from the magnocellular preoptic nucleus [85,97-99], The 
ventral lateral preoptic area (VLPO) serves a well-recognized role in the initia¬ 
tion and maintenance of non-REM sleep. VLPO projections to DR (as well as 
to other monoaminergic groups of the brainstem) are well characterized. Sev¬ 
eral reports have shown that VLPO fibers distribute heavily throughout all sub¬ 
divisions of DR [97, 100-102], According to recent accounts, 5-HT DR neu¬ 
rons reciprocally connect with, and exert mutual inhibitory actions, on VLPO 
neurons of the basal forebrain [2, 103-105], 
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Projections from the diencephalon to DR 

Diencephalic input to DR mainly originates from the hypothalamus, consider¬ 
ably less so from the thalamus, and within the hypothalamus predominantly 
from hypothalamic nuclei that have been linked to sleep and circadian systems. 
These would include the perifornical region, the lateral hypothalamus (LHy), 
the tuberomammillary nucleus (TMN) and the dorsomedial nucleus (DMH) 
[22, 83, 84, 85, 86, 104-109], Several reports have shown that DR is strongly 
targeted by fibers from the LHy/perifomical region, with a large percentage 
originating from hypocretin (orexin)-containing cells of this area [22, 86, 106, 
110, 111], Hypocretin exerts excitatory actions on DR neurons, presumably to 
support wakefulness [112-114], 

While an early report by Peyron et al. [85] described modest TMN projec¬ 
tions to DR, a recent study demonstrated relatively pronounced TMN-DR 
projections, to virtually all subdivisions of DR [107], Although a significant 
percentage of TMN cells projecting to DR are histaminergic neurons, a size¬ 
able number are GABAergic cells [99, 107], 

Recent evidence indicates that the dorsomedial nucleus of the hypothalamus 
represents a major “hub” in the homeostatic regulation of various functions, 
including circadian influences on feeding, temperature and locomotor activity 
[115, 116], The DMH distributes substantially throughout DR, and may in 
part, through actions on DR, serve as an important link in circadian control of 
sleep-waking states [85, 115-117], Finally, the arcuate, ventromedial, paraven¬ 
tricular, supramammillary, and posterior nuclei of the hypothalamus distribute 
significantly to DR [85, 86, 118, 119], 

With exception of the habenula (see below) the thalamus sends limited in¬ 
put to DR and almost exclusively from the paraventricular (PV) and paratenial 
(PT) nuclei of the midline thalamus. Peyron et al. [85] identified moderate num¬ 
bers of labeled cells in the caudal PV following retrograde tracers injections in 
DR. 

As mentioned, the LH is a major source of afferents to DR [22, 83-86, 120, 
121], Early reports indicated that LH is a critical relay in the transfer of infor¬ 
mation from the limbic forebrain to the brainstem (part of the limbic midbrain 
circuit of Nauta) [82, 121-123], Accordingly, habenular input to DR report¬ 
edly serves multiple limbic functions, prominently including regulation of emo¬ 
tional behavior. The disruption of the habenulo-raphe pathway may contribute 
to serotonergic dysfunctions in mood and anxiety disorders. 


Projections from the amygdala to DR 

The projections from the amygdala to DR originate from few cell groups of 
the amygdala, primarily from the medial nucleus of amygdala (MEA) and to a 
lesser extent from the central nucleus (CEA) [85, 124], In a recent examination 
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of amygdalar projections to various sectors of DR, Waterhouse and co-work¬ 
ers [125] described significant numbers of labeled cells in the medial portion of 
MEA following retrograde tracer injections in the rostral, central and caudal 
parts of DR, and labeled cells in lateral MEA (and to a limited extent in CEA) 
with injections into the lateral wings of DR. 


Projections from the brainstem to DR 

The major sources of brainstem afferents to DR are from DA groups of the 
midbrain (VTA and SNc), IP, the midbrain and pontine gray, other raphe nu¬ 
clei (mainly MR and raphe magnus), the parabrachial nucleus, LDT, cranial 
nerve nuclei, the rostral ventrolateral medullary zone and the nucleus of the 
solitary tract [83, 84, 86, 121, 126, 127], Interestingly, although DA groups, 
VTA and SNc, heavily target DR, projections primarily originate from GAB- 
Aergic neurons of these nuclei [127, 128], The relatively substantial DA input 
to DR largely arises from the medial ZI (or A13 group) [85, 127], 

As demonstrated, using various tracers, the MR and DR are extensively in¬ 
terconnected [9, 10, 11, 17, 50], Although the forebrain projections of DR and 
MR are relatively segregated (see above), these two major 5-HT nuclei may 
exert global serotonergic actions on the forebrain through their extensive inter¬ 
connections. An additional source of raphe input to DR is from raphe magnus, 
which in conjunction with PAG afferents, appear to serve a role in nociceptive 
behaviors [84, 99, 102], 

Among its various functions, DR is thought to be critically involved in the 
control of sleep-wake states as well as some events of REM sleep. Specifically, 
the cessation of firing of 5-HT DR neurons in REM sleep reportedly serves 
to disinhibit populations of cholinergic neurons of the LDT and LDT of the 
dorsolateral pons to trigger both PGO spikes of REM as well as the REM 
state (for review see [2]). In this regard, there are significant interconnections 
between DR and LDT/PPT and also between DR and LC. It appears that DR 
projections to LC are considerably more pronounced than LC projections to 
DR [17, 63, 86, 127, 129, 130], 


Afferents to the MR 

Although their outputs are distinct, DR and MR share common sets of af¬ 
ferents. The main sources of afferent projections to MR are from the mPFC, 
preoptic area, perifomical, dorsomedial, and lateral hypothalamic areas, 
mammillary and supramammillary nucleus, LH, interpeduncular nucleus, 
DR, B9, midbrain and pontine central gray, LDT and caudal raphe nuclei 
[131, 132], 
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Forebrain projections to MR 

Similar to DR, cortical input to MR predominantly arises from limbic cortices. 
MR receives strong projections from the mPFC (AGm, AC and PL), and some 
but less so from the agranular insular cortex [90, 91, 131, 132], Behzadi and 
colleagues [132] identified small numbers of labeled neurons in the retrosplenial 
and ventral and lateral orbital cortices following MR injections, but acknow¬ 
ledged that this may have been to due to the spread of the tracer to DR. 

Several cell groups of the basal forebrain, spread across the BF, project to 
MR. These mainly include BST, diagonal band nuclei, medial and lateral sep¬ 
tum, ventral pallidum and the medial and lateral preoptic areas [131-133], Ma¬ 
jor afferents originate from MS, LS, VP and medial and lateral preoptic areas, 
and to a considerably lesser extent from BST, the medial preoptic nucleus and 
diagonal band nuclei (DBv/DBh) [83, 97, 98, 131, 132], 

Similar to the DR, the MR receives relatively pronounced projections from 
several sites implicated in sleep-wake control including VLPO, perifornical/late- 
ral hypothalamus and DMH [22, 83, 97, 100, 101, 109, 131, 132], Orexin-im- 
munoreactive fibers are present in MR, which suggest that a percentage of the 
descending hypothalamic projections from these regions contain the neuropep¬ 
tide [110], 

MR provides the major 5-FIT input to the suprachiasmatic nucleus (SCN), 
but as recognized, SCN does not project directly back to raphe nuclei [10, 11, 
117, 134], As has been shown, however, that the SCN directly communicates 
with DMH and the subparaventricular nucleus of the hypothalamus, and 
DMH targets MR [22, 115-117, 131, 132], Similar to circuitry proposed for the 
DR [117], the DMH seems to be an important link in communication between 
MR and SCN. Other hypothalamic sites with projections to MR include the 
mammillary bodies, (medial and lateral mammillary nuclei), SUM, PH and the 
arcuate, paraventricular, and ventromedial nuclei of the hypothalamus [22, 118, 
119, 131, 132], 

The LH is a rich source of input to MR [22, 83, 120, 121, 131, 132], and is 
postulated as a route for the transfer of information from the limbic forebrain 
to the brainstem [83, 121, 123], The interpeduncular nucleus also distributes 
significantly to MR, and is viewed as an important secondary pathway from 
the LH to MR (habenulo-interpeduncular-MR connections) [121, 131, 132, 
135], Finally, analogous to DR, the medial nucleus of the amygdala appears to 
be the sole source of amygdalar input to MR, and this innervation is modest at 
best [131, 132], 


Brainstem projections to MR 

The major sources of brainstem input to MR are VTA, SNc, DR, the supral- 
emniscal nucleus (B9), caudal raphe nuclei, midbrain and pontine central gray, 
LDT, LC and some cranial nerve nuclei [83, 131, 132], 


Efferents and afferents of the dorsal and median raphe nuclei 


95 


Several 5-HT raphe nuclei, including DR, B9, raphe pontis, raphe magnus, 
and raphe obscurus, provide substantial input to MR [17, 50, 131, 132], As in¬ 
dicated previously, DR and MR strongly interconnect [9, 10, 11, 17, 50], Inter¬ 
estingly, the supralemniscal nucleus (or B9) [7] distributes significantly to MR, 
but essentially avoids DR [83, 131, 132], The functional significance of B9-MR 
connections is unknown. 

Finally, it is important to emphasize that, similar to DR, the median ra¬ 
phe is strongly reciprocally linked with LDT and LC [130-132, 136], In fact, 
Marcinkiewicz et al. [131] noted that LDT is one of the heaviest sources of 
afferent projections to MR. Communication between MR/DR and sleep-wake 
control sites of the brainstem (e.g., LC, LDT, PPT and parabrachial nuclei) are 
undoubtedly critical for the modulation of various physiological indices of the 
sleep/wake cycle (for review see [2, 45]). 
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Abstract 

The primary circadian pacemaker resides within the suprachiasmatic nucleus (SCN) in the 
hypothalamus, and controls the circadian rhythms of virtually all mammalian behaviors 
and physiological processes, including sleep and wakefulness. Serotonergic neurons in the 
midbrain dorsal (DRN) and median (MRN) raphe nuclei have been suggested to play an 
important role in behavioral state control. These neurons also show circadian rhythmicity 
in their activity, and may be an important target of the SCN circadian signal for organiz¬ 
ing circadian sleep-wake rhythms. There are, however, no direct efferent projections from 
the SCN to the DRN or the MRN, suggesting that most of the SCN neuronal output 
may be conveyed indirectly. In this review, we first provide an overview of the anatomi¬ 
cal evidence for the indirect neuronal pathways from the SCN to the DRN and MRN via 
several hypothalamic nuclei, namely, the medial preoptic area, subparaventricular zone, 
and dorsomedial hypothalamic nucleus. We discuss functional evidence to suggest that 
the SCN may influence the regulation of sleep-wake states by sending its circadian signal 
through these indirect pathways to the raphe nuclei. We then consider the feedback projec¬ 
tions from the DRN and MRN to the SCN, and discuss functional evidence to suggest 
that these projections carry feedback information to the SCN regarding the vigilance state 
of the animal. We hypothesize that the reciprocal interactions between the circadian and 
sleep-wake regulatory systems may ensure a stable yet adaptive rhythmicity of daily sleep- 
wake cycles. 
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Introduction 

Circadian regulation of sleep-wake cycles by the suprachiasmatic nucleus 

The circadian (i.e., ~24 h) organization of sleep and wakefulness is controlled 
by the central pacemaker localized within the suprachiasmatic nucleus (SCN) 
of the hypothalamus (for reviews see [1, 2]). Recent studies have shown the 
presence of circadian oscillators in other areas of the brain and the periphery 
in mammals; however, the SCN is the dominant oscillator (for a review see 
[3]). The initial evidence for the critical role of the SCN in controlling daily 
sleep-wake cycles, provided by studies in the 1970s and early 1980s and repeat¬ 
edly confirmed by later studies, is that lesions of the SCN in rats permanently 
abolish daily sleep-wake rhythms, regardless of lighting condition [4-8], Inter¬ 
estingly, these studies also showed that the total amount of sleep either did 
not change or was only slightly increased after SCN lesions, suggesting that 
the SCN does not play a significant role in regulating the amount of sleep, at 
least in the rat. In other species, such as squirrel monkeys [9] and some strains 
of mice [10], SCN lesions not only eliminated the daily rhythm of sleep but 
also increased total daily sleep time, suggesting that the SCN may also be res¬ 
ponsible for the regulation of the amount of sleep in these species. One recent 
interpretation of these data is that, in all the species examined so far, the SCN 
actively promotes wakefulness during the active phase, and sleep during the 
rest phase, of the 24-h light-dark cycle [11], 

The mechanisms and pathways by which the SCN circadian pacemaker im¬ 
poses its temporal control over sleep-wake cycles are only beginning to be un¬ 
derstood. Unlike the circadian oscillatory mechanisms, which are compactly 
housed in the SCN, sleep-wake states are controlled by widely distributed and 
closely interconnected neuronal groups in the basal forebrain, hypothalamus, 
and brainstem (for reviews see [12, 13]). It is reasonable to assume, initially, 
that the SCN uses “hard-wired” neuronal projections to send circadian signals 
to the sleep-wake regulatory system. The direct SCN efferent projections are, 
however, mostly confined within the medial hypothalamus, with the densest of 
these projections terminating in the subparaventricular zone (SPVZ), a region 
just above the SCN and ventral to the paraventricular hypothalamic nucleus 
(for reviews see [1,14-16]). 

Nonetheless, the hypothalamus contains several key sleep-wake regulatory 
cell groups and of these, the medial preoptic area (MPA), long implicated in 
promoting sleep (for a review see [17]), receives strong innervation from the 
SCN [1, 14-16], In addition, sparse projections from the SCN reach GABAer- 
gic/galanin-containing neurons in the ventrolateral preoptic nucleus, involved 
in promoting sleep [18, 19], and orexin (hypocretin)-containing neurons in the 
lateral hypothalamus, involved in promoting wakefulness [20], Most nuclei of 
the sleep-wake regulatory system are, however, not directly innervated by the 
SCN. Thus, it appears that the SCN sends only a limited amount of direct axo- 
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nal projections to the sleep-wake system. In light of the fundamental biological 
importance of circadian sleep-wake rhythms, it is then highly conceivable that 
much of the neuronal output from the SCN to the sleep-wake regulatory sys¬ 
tem is conveyed via indirect projections, and there is evidence to support this 
possibility. 

In addition to neuronal signals, the SCN may also regulate circadian rhythms 
of sleep-wake cycles by releasing humoral signals. Circadian rhythms in hams¬ 
ter locomotor activity persisted after knife cuts were made to isolate the SCN 
from the rest of the brain, suggesting a possibility of cellular communication 
through humoral factors that may be secreted from the SCN [21], Circadian 
locomotor activity was reinstated by transplants of fetal SCN graft encased 
in a semipermeable capsule (that allows the release of diffusible substances 
from the SCN but not neuronal outgrowth) in behaviorally arrhythmic SCN- 
lesioned adult hamsters [22], Recent studies have identified several possible hu¬ 
moral circadian signals in nocturnal rodents that can inhibit locomotor activity 
rhythms, including transforming growth factor-alpha [23], prokineticin 2 [24], 
and cardiotrophin-like cytokine [25], However, behavioral rhythms restored in 
SCN-lesioned hamsters bearing grafts were not as regular or stable as those 
of intact hamsters, and circadian rhythms of hormones such as corticosterone 
and melatonin were not restored in SCN-transplanted animals [26], Thus, the 
neuronal efferent projections from the SCN appear to be necessary for the full 
expression of circadian rhythms of locomotion and other functions. 

In summary, the circadian rhythm of sleep-wake states may be mediated 
through both direct and indirect axonal projections from the SCN to the sleep- 
wake regulatory system. Humoral factors released by SCN cells may also play a 
role in transmitting the circadian message; however, this is beyond the scope of 
this review and is not discussed further. 


The role of the midbrain raphe serotonergic system 
in behavioral state control 

Serotonin (5-hydroxytryptamine, 5-HT) has long been implicated in the regu¬ 
lation of sleep-wake states (for reviews see [27-30] and the chapter by Ursin), 
although it is still controversial where and how serotonin exerts its principal 
effect on such regulation. Historically, serotonin was initially postulated to be 
a sleep-promoting substance. For example, early pharmacological studies in 
the cat indicated that inhibition of serotonin synthesis by p-chlorophenylala- 
nine led to sleep loss, which could be reversed by restoring serotonin synthesis 
[31, 32], Furthermore, electrolytic lesions of the brainstem raphe system includ¬ 
ing the dorsal and median raphe nuclei (DRN and MRN, respectively), which 
are the main sources of ascending serotonergic projections to the forebrain (for 
a review see [33]), resulted in a decrease of both sleep and forebrain serotonin 
contents in the cat [34], However, subsequent studies that correlated serotoner- 
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gic tone with behavioural states showed that increased activity of the seroto¬ 
nergic system is, in fact, associated with wakefulness, and not sleep. In the cat, 
putative serotonergic neurons in both the DRN [35, 36] and MRN [37, 38] dis¬ 
charged at their highest rate during wakefulness, reduced their firing rate dur¬ 
ing non-rapid eye movement (NREM) sleep, and virtually stopped firing dur¬ 
ing REM sleep [35, 36], Correspondingly, the level of extracellular serotonin in 
a number of forebrain areas was the highest during wakefulness and the lowest 
during REM sleep [39, 40], This pattern of activity of serotonergic DRN and 
MRN neurons suggested a role of serotonin in either promoting wakefulness or 
suppressing REM sleep, rather than promoting sleep. The previously reported 
loss of sleep that resulted from low serotonergic tone may have been due to the 
nonspecific effects of the lesion and pharmacological approaches used in those 
early experiments. To add another level of complexity, multiple pre- and post- 
synaptic serotonergic receptors are present in different areas of the brain that 
are associated with the control of sleep and wakefulness [28-30], 

Taken together, these results suggest a complex role of midbrain raphe se¬ 
rotonergic neurons in sleep-wake regulation. Regardless of the mechanisms, 
however, the importance of serotonergic neurons of the DRN and MRN in 
behavioral state control may suggest that they represent an important target of 
the circadian clock located in the SCN. In support of this, there is evidence for 
circadian rhythmicity in raphe serotonergic activity. 


Circadian rhythms in midbrain raphe serotonergic activity 

If the midbrain raphe serotonergic system were involved in circadian control of 
sleep and wakefulness, one would expect its activity to show circadian rhythms. 
A variety of approaches have been used to demonstrate daily rhythmicity in 
DRN and MRN serotonergic activity, including firing rate, c-Fos immunore- 
activity (c-Fos is a transcription factor whose expression is related to neuronal 
activation), serotonin release, and expression and activity of tryptophan hy¬ 
droxylase (TpH, the rate-limiting enzyme in the synthesis of serotonin). 

Using multi-unit activity recordings from the DRN and MRN of nocturnal 
rats, Inouye and Kawamura [41] observed higher firing rate during the dark 
phase than the light phase at one (but not the other) of their two unspecified 
recording sites within the DRN, and at the only and unspecified recording site 
in the MRN. These daily patterns disappeared when a circular knife cut was 
made to isolate the SCN, suggesting that these rhythms were most likely driven 
by the SCN via its efferent pathways. 

Janusonis and Fite [42] used c-Fos immunoreactivity to monitor rhythmic 
neuronal activity in the DRN of Mongolian gerbils, a crepuscular species. The 
number of c-Fos-immunoreactive cells was the highest 1 h after lights-off, when 
locomotor activity is high. The c-Fos rhythms were particularly pronounced 
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in the caudal DRN, and c-Fos immunoreactivity was present mostly in non- 
serotonergic cells. Unlike the c-Fos immunostaining, however, serotonin immu- 
nostaining in the DRN of Mongolian gerbils was the lowest 1 h after lights- 
off [43], 

A number of studies have reported daily rhythms in extracellular levels of 
serotonin in forebrain sites, including the SCN (for a review see [28]). Consis¬ 
tent with the firing patterns of DRN and MRN neurons, in vivo microdialysis 
in freely moving nocturnal rats revealed peak levels of serotonin during the 
early dark phase in the prefrontal cortex, striatum, hippocampus, and amyg¬ 
dala [44, 45], All of these regions receive innervation from the DRN, MRN, 
or both [46, 47], Levels of serotonin were positively correlated with the time 
spent in active wake-related behaviors [44,45], Serotonin levels in the SCN also 
peaked at the beginning of the dark phase in both hamsters [48] and rats [49, 
50], Under constant darkness, SCN serotonin levels increased at the beginning 
of the usual active period (“subjective night”; [48]), indicating that this rhythm 
is endogenously driven. 

Interestingly, the daily patterns of serotonin contents in the DRN and MRN 
are different from those described for the aforementioned forebrain sites and 
from the firing patterns of DRN and MRN neurons, although these results 
are somewhat inconsistent. In the rat and hamster, serotonin contents in both 
the DRN and MRN reached a peak during the light phase [51-54], When rats 
were housed in constantly dark conditions, one study showed that the rhythms 
in serotonin contents in both raphe nuclei were maintained but drifted out of 
phase with those seen under light-dark conditions [52], whereas a second study 
showed that only the rhythm in serotonin contents in the DRN, and not the 
MRN, was maintained [51], It is possible that serotonin contents in the DRN 
and MRN may reflect not only release from collaterals of serotonergic neurons 
therein, but also a possibly rhythmic release of serotonin by serotonergic termi¬ 
nals arising elsewhere. 

A number of studies in nocturnal rats have demonstrated circadian rhythms 
in TpH levels in the MRN, lateral DRN, and their projection areas within the 
circadian system. In situ immunoautoradiography measurements in both the 
MRN and the lateral DRN showed a peak of TpH protein levels in the middle 
of the dark phase [49, 55], In contrast, TpH protein levels in both the SCN 
(which receives serotonergic projections from the MRN; [56-58]) and interge- 
niculate leaflet of the thalamus (which receives serotonergic projections from 
the DRN; [56-58]) were highest near the time of the light-dark transition when 
SCN serotonin levels are high [49, 55], When the rats were maintained in con¬ 
stant darkness, the daily patterns of TpH protein levels in all of these nuclei 
remained similar to those observed under a light-dark cycle [49, 55], The TpH 
mRNA levels in the DRN (in both the lateral and medial regions) and MRN 
showed a peak at the end of the light phase (~8 h before the maximum values 
of protein amount), with a similar profile under constant darkness [59], In add¬ 
ition, it has been found that the activity of TpH in both the DRN and MRN 
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was the highest at the end of the dark phase in nocturnal rats [60], The differ¬ 
ences in the timing of peak in TpH protein and mRNA levels, in TpH activity, 
and in serotonin release may be due to the nature of the machinery involved in 
synthesis and release of serotonin as well as presynaptic regulation of transmit¬ 
ter release. 

It is important to recognize that circadian rhythms in serotonergic activity 
may reflect either a circadian SCN influence on serotonergic activity or wake- 
associated serotonergic activity, because discharge rate, serotonin release in the 
DRN, and TpH mRNA levels in the DRN and MRN are highest during wake¬ 
fulness and particularly during locomotor activity [35-39, 61]. One approach 
to eliminate this “confound” of behavioral state was to compare the activity 
of DRN serotonergic neurons during the same behavioral state, in the cat, be¬ 
tween the light and dark phases. When compared in this way, neither firing 
rate nor serotonin release showed differences [45, 62], These findings suggest 
that the daily changes in serotonergic activity simply reflected different times 
spent in wakefulness and not purely a circadian influence. Cats, however, may 
not be a good model for investigating this question, as they do not show robust 
circadian rhythms of sleep and wake. It has also been found that the rhythmic 
patterns of TpH mRNA in the DRN and MRN were dependent on daily fluc¬ 
tuations of glucocorticoids levels [61], suggesting the possibility that endocrine 
rhythms may drive TpH mRNA rhythms in these raphe nuclei. 

Despite the demonstration of circadian rhythmicity in some aspects of 
serotonergic activity, the role of midbrain raphe serotonergic neurons in the 
circadian organization of sleep-wake cycles remains unclear. Electrolytic lesions 
of the midbrain raphe in the rat only transiently disrupted daily sleep-wake 
rhythms during the light-dark cycle [63, 64], Similar results were seen following 
the selective lesions of serotonergic neurons in the rat DRN or MRN with local 
injection of the neurotoxin 5,7-dihydroxytryptamine [65], This lack of effect 
is perhaps not surprising since additional circuits could presumably compen¬ 
sate for damage to the serotonergic system. Furthermore, the animals were not 
tested under constant darkness in these studies, so it is unclear whether such 
lesions would disturb the circadian organization of sleep and wakefulness un¬ 
der constant conditions. In fact, there is strong evidence for a role of serotonin 
in the entrainment of circadian rhythms of behavioral activity by both photic 
and non-photic stimuli (for reviews see [16, 66, 67]), and these are discussed 
further in the section Feedback projections from the DRN and MRN to the SCN 
below. 

In summary, some aspects of serotonergic activity, including serotonin re¬ 
lease and TpH levels, maintain daily rhythms under constant darkness. Thus, 
these daily rhythms, which are also correlated with daily variations of behav¬ 
ioral activity and glucocorticoid levels, are very likely driven endogenously. It is 
possible that circadian behavioral and endocrine rhythms (which are controlled 
by the SCN) may drive the rhythmic functioning of serotonergic neurons in 
the DRN and MRN. It is also possible, however, that such rhythmicity is con¬ 
trolled by the SCN through indirect neuronal pathways to the raphe nuclei. 
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Indirect neuronal projections from the SCN 
to the DRN and MRN 


Anatomical evidence 

As previously mentioned, the SCN has virtually no direct projections to the 
DRN and MRN but it is plausible that indirect pathways connect the SCN 
with the DRN and MRN. The major direct targets of SCN efferents include 
the MPA, SPVZ, and dorsomedial hypothalamic nucleus (DMH) (for reviews 
see [1,14-16]). To test the possibility that these nuclei may represent relays link¬ 
ing the SCN with the sleep-wake regulatory system, we recently used a dual 
tract-tracing technique in combination with immunohistochemistry for trans¬ 
mitter-specific markers of key cell groups of the sleep-wake system in the rat 
[68-70], We injected one of the three possible relay nuclei with a mixture of 
the retrograde tracer cholera toxin subunit-B (CTB) and the anterograde tracer 
biotinylated dextran amine (BDA), and examined in the same animal both 
retrograde labeling in the SCN and anterograde labeling in the DRN [70] and 
MRN (unpublished observations, S. Deurveilher and K. Semba). We identified 
the dorsomedial (shell) and ventrolateral (core) region of the SCN using vaso¬ 
pressin and neuropeptide Y, respectively. The shell and core regions have dif¬ 
ferent anatomical connections, contain different neurochemical markers, and 
are implicated in different aspects of timekeeping mechanisms in the SCN (for 
a review see [1]). The DRN and MRN were identified with immunohistochem¬ 
istry for serotonin. A potential relay nucleus between the SCN and the DRN 
and MRN was identified when both retrograde labeling (with CTB) in the SCN 
and anterograde labeling (with BDA) in the DRN or MRN were seen. Moder¬ 
ate to dense labeling was observed in the SCN, DRN and MRN. Examples of 
retrograde labeling in the SCN and anterograde labeling in the DRN following 
BDA + CTB injections into the MPA and DMH are shown in Fig. 1. Using 
this strategy we found that the MPA, SPVZ, and DMH may all be potential re¬ 
lays between the SCN and the DRN and MRN. These results are summarized 
in Fig. 2. It should be noted that synaptic connections between SCN afferents 
and neurons in each potential relay nucleus that project to the DRN and MRN 
remain to be investigated. 


Efferent projections of the SCN to the MPA, SPVZ, and DMH 

We found that injections of a cocktail of tracers into the rat MPA, SPVZ, and 
DMH resulted in strong retrograde labeling in the SCN ipsilateral to the injec¬ 
tion site [68], Projections were topographically organized, with injections into 
the MPA and DMH resulting in more labeled neurons in the shell than in the 
core region of the SCN (Fig. lb), consistent with previous retrograde tracing 
studies in the rat [71-75], There appears to be some species differences, how- 
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ever. In the hamster, CTB injections into the MPA labeled neurons primarily 
in the shell SCN (as in the rat), but injections into the DMH labeled similar 
numbers of neurons in the shell and core [76], 

More detailed topography of the SCN efferents to the MPA and DMH was 
revealed by studies using anterograde tracers. For example, phaseolus vulgaris 
leucoagglutinin (PHA-L) injections into the shell region of the rat SCN labeled 
more terminals in the DMH than did injections into the SCN core [77]; the pat¬ 
tern of anterograde labeling produced by core injections in the same study ap¬ 
peared to be fairly similar to that described earlier using the same tracer in the 
study of SCN projections by Watts and colleagues [78], Although SCN effer¬ 
ents were found widely scattered throughout the MPA and DMH, preferential 
innervation by SCN efferents was found in the ventral and medial parts of the 
MPA and in the medial part of the DMH [72, 77, 79, 80], Vasopressin- and va¬ 
soactive intestinal polypeptide (VIP, another marker of the core SCN)-contain- 
ing fibers originating from the SCN have been found in the MPA and DMH in 
the hamster [81], rat [77, 82, 83] and mouse [84], 

In contrast to injections into the MPA and DMH, injections into the SPVZ 
produced an equal density of retrograde labeling in the shell and core regions 
[68], Similarly, dense projections to the SPVZ from both subdivisions of the 
SCN have been demonstrated in a number of studies using anterograde and 
retrograde tracing techniques, although the patterns of organization reported 
in these studies are slightly different. Using a retrograde tracing technique in 
the rat, Leak and colleagues [71, 74] showed that the medial region of the SPVZ 
received projections primarily from the SCN shell, while the lateral region of 
the SPVZ received projections primarily from the SCN core (although there 
was some overlap). This is consistent with the observation that vasopressin- 
containing fibers (presumably originating from the shell) lie medially to VIP- 
containing fibers (presumably originating from the core) within the rat SPVZ 
[72, 85], Vrang and colleagues [86] reported a different organization in the rat: 
projections of SCN shell neurons reached the paraventricular hypothalamic 
nucleus (which lies just dorsal to the SPVZ), while the SCN core projections 
targeted the SPVZ. A large overlap of shell and core projections within the 
SPVZ appears to exist in the hamster [76, 81] and the mouse [84], The differ¬ 
ences reported in these studies may be related to differences in species or injec¬ 
tion sites, but they nonetheless emphasize the presence of direct output from 
the SCN to both the SPVZ and paraventricular hypothalamic nucleus. 

In addition to neuropeptides, GABA and glutamate are likely contained in 
at least some SCN efferents to the MPA, SPVZ, and DMH. It was reported that 
all or nearly all SCN neurons contain GABA [87, 88], However, only 20-30% of 
anterogradely labeled SCN fibers in the rat DMH were found to be labeled for 
GABA [89], Electrophysiological evidence suggests that SCN efferents release 
both GABA and glutamate into other hypothalamic nuclei, including the para¬ 
ventricular hypothalamic [90] and ventrolateral preoptic nuclei [91, 92], These 
small molecule neurotransmitters may colocalize with various neuropeptides in 
SCN efferent terminals. For example, GABA was found to be colocalized with 
vasopressin and VIP in a portion of axons in the DMH [93], 


Reciprocal SCN raphe nuclei pathways 


111 



Fig. 1 Examples of retrograde labeling in the suprachiasmatic nucleus (SCN) and ante¬ 
rograde labeling in the dorsal raphe nuclei (DRN) following biotinylated dextran amine 
(BDA) plus cholera toxin subunit-B (CTB) injections into the dorsomedial hypothala¬ 
mic nucleus (DMH) (a-c) or the medial preoptic area (MPA) (d). (a) A relatively small 
injection site, visualized with BDA labeling, is located in the ventrolateral region of 
the DMH. (b) In the SCN, neurons retrogradely labeled with CTB (appearing in black; 
examples are shown by arrows) are found intermixed with vasopressin-immunoreactive 
neurons (appearing in gray) in the shell region of the SCN. (c) Fibers and terminals 
that are anterogradely labeled with BDA are present throughout the DRN, and are par¬ 
ticularly dense in the dorsolateral region, (d) Following an injection of BDA+CTB in 
the dorsolateral region of the MPA, varicose BDA-labeled fibers (appearing in black; 
arrows) were found intermixed with serotonin-immunoreactive neurons (appearing in 
gray) in the lateral region of the DRN. Some BDA-labeled terminals are adjacent to 
serotonergic cell bodies, but most do not appear to be specifically associated with sero¬ 
tonergic neurons. 3V, third ventricle; 4V, fourth ventricle; fx, fornix; mlf, medial longi¬ 
tudinal fasciculus; mt, mammillothalamic tract. Scale bars: (a), 500 pm; (b), 50 pm; (c), 
200 pm; (d), 40 pm 
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Reciprocal connections between the SCN 
and the midbrain raphe nuclei 



Fig. 2 A schematic summary of the reciprocal connections between the SCN and the 
midbrain DRN and median raphe nucleus (MRN). The SCN sends efferent projections 
(solid lines) to the DRN and MRN via putative relays in the MPA and DMH; the sub- 
paraventricular zone (SPVZ) may also serve as an intermediary via its projections to 
the DMH. In turn, the SCN receives afferent projections (broken lines) directly from 
serotonergic neurons in the MRN, and indirectly from serotonergic neurons in the DRN 
via the thalamic intergeniculate leaflet (IGL). The DRN and MRN are also reciprocally 
connected (solid arrows) 


In summary, SCN efferent projections directly innervate the MPA, SPVZ, 
and DMH, and these projections are topographically organized. The shell pro¬ 
jections to the MPA and DMH are more extensive than the core projections to 
the same regions, while both the core and shell project to the SPVZ. These pro¬ 
jections appear to differ in their contents of neuropeptides and small molecule 
neuro transmitters. 


Afferent projections to the DRN and MRN from the MPA, 

SPVZ and DMH 

When the mixed tracers were injected into MPA, SPVZ, and DMH, those in¬ 
jected into the SPVZ produced the lowest, and those into the DMH resulted 
in the highest, density of anterogradely BDA-labeled fibers in the DRN [70], 
The density of labeled fibers was generally less in the MRN than in the DRN 
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after any injection. With MPA and DMH injections, BDA-labeled fibers and 
terminals were seen throughout the DRN, particularly in the dorsolateral re¬ 
gion (Fig. lc), and were more dense ipsilateral to the injection site. Some of the 
fibers and terminals appeared to appose serotonin-immunoreactive cell bodies 
and dendrites in the DRN. However, many did not, suggesting that they may 
instead target unlabeled distal dendrites of serotonergic neurons, or somata 
and processes of non-serotonergic neurons (Fig. Id). 

The above results using the mixed tracers are in agreement with previous 
reports using anterograde or retrograde tracers. At least some anterogradely 
labeled fibers were observed in all DRN subdivisions and in the MRN follow¬ 
ing injection of anterograde tracers into the DMH [73, 94] and MPA [95-98] in 
the rat. Several retrograde tracing studies have confirmed projections from the 
MPA and DMH to the DRN and MRN in the rat. Many retrogradely labeled 
cells were found in either the MPA or DMH following injection of retrograde 
tracers into the DRN [99-102] or MRN [100], Discrete injections of retrograde 
tracers into each subdivision of the DRN resulted in at least some retrogradely 
labeled neurons in the MPA and DMH [103, 104], confirming that all subdivi¬ 
sions of the DRN are innervated by the MPA and DMH; in the latter study 
[104], however, there was a preferential innervation of the rostral DRN by 
DMH neurons. 

The neurotransmitters in the pathways originating from the MPA and DMH 
and the specific neuronal targets within the DRN and MRN remain to be iden¬ 
tified. Some of the projections from the MPA to the DRN appear to be GAB- 
Aergic, whereas projections from the DMH to the DRN appear to be neither 
GABAergic [105] nor glutamatergic [99], While at least some of the DMH neu¬ 
rons projecting to the DRN contain orexin [104], additional neuropeptides may 
be present. Both the MPA and DMH contain various neuropeptides includ¬ 
ing corticotropin-releasing factor, neurotensin, galanin [106-108] and, in the 
case of the DMH, thyrotropin-releasing hormone [109], Functionally, many 
of these neuropeptides have strong effects on the firing rates of DRN neurons 
[110-112], In addition to studies aimed at determining the neurochemical con¬ 
tents of MPA and DMH projections to the DRN and MRN, ultrastructural 
studies are also needed to examine whether synaptic connections exist between 
axonal varicosities originating from the DMH or MPA, and specific neurons in 
the raphe nuclei (e.g., serotonergic, GABAergic, glutamatergic, and dopami¬ 
nergic [113-115]). 

In summary, the afferents to the DRN and MRN include projections arising 
from the MPA and DMH. Using a dual tract-tracing strategy we have con¬ 
firmed that the MPA and DMH receive strong afferent projections from the 
SCN and, in turn, project to the DRN and MRN. These findings suggest that 
the MPA and DMH may serve as relays to mediate the SCN output to these 
raphe nuclei. The SPVZ is also strongly innervated by the SCN but has only a 
minor projection to the DRN and MRN. The SPVZ projects strongly to the 
DMH, however, and thereby may project indirectly to these raphe nuclei via 
the DMH. 
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Functional evidence 

The anatomical evidence reviewed above indicates an interesting possibility 
that the MPA and DMH may serve as putative relays linking the SCN axonal 
outputs to DRN and MRN neurons. The SPVZ may also be part of an indirect 
relay circuit between the SCN and the DRN and MRN via its projections to the 
DMH. As DRN and MRN neurons appear to be involved in the regulation of 
the sleep-wake cycle, the indirect neuronal pathways to these raphe nuclei may 
contribute to the circadian regulation of behavioral states. Do these pathways 
show physiological characteristics that would be required for this hypothesized 
role? At least two conditions should be met. One is that SCN-controlled cir¬ 
cadian rhythms in neuronal activity should be present in the putative relays. 
A second condition is that stimulation or lesion of the putative relays should 
affect circadian sleep-wake rhythms. 


Daily rhythms in the MPA, SPVZ, and DMH 

Multi-unit activity recordings from the hypothalamus of freely moving 
nocturnal rodents revealed daily rhythms in firing rate in the preoptic area 
(possibly including the MPA) and the ventral region of the SPVZ; no data 
have been reported for the DMH. Similar to DRN and MRN cells, preoptic 
area cells showed a higher firing rate during the dark than the light phase; 
this rhythm was in opposite phase to that shown by SCN cells [116, 117]. The 
rhythms in preoptic neurons persisted in constant darkness, with a peak during 
the “subjective night” in phase with increased locomotor activity [118]. The 
result in that latter study, which was based on only a single recording site, sug¬ 
gests that these firing rhythms were endogenously driven. Cells in the ventral 
SPVZ showed a mixed pattern of firing - some cells increased firing during the 
light phase, others during the dark phase; these rhythms persisted in constant 
darkness [41], 

Other studies have used c-Fos immunohistochemistry to examine daily 
rhythms in neuronal activity in the MPA, SPVZ, and DMH in nocturnal and 
diurnal rats. The number of c-Fos-labeled cells in both the MPA and DMH of 
nocturnal rats increased during the dark phase [119, 120], similar to MPA cell 
firing patterns. This light-dark pattern of c-Fos labeling was also present in the 
MPA and DMH of female rats in the early stage of pregnancy, but the pattern 
was reversed in the late stage of pregnancy [121], In contrast to the MPA and 
DMH, the c-Fos staining in the SPVZ (both ventral and dorsal regions) peaked 
1 h after lights-on, followed by a decrease throughout the rest of the light and 
dark phase [122, 123], This brief increase may explain why other studies did 
not reveal any c-Fos rhythms in the SPVZ [119, 124], Unlike multi-unit activ¬ 
ity rhythms in the ventral SPVZ, however, the c-Fos rhythm in the same region 
was abolished under constant darkness, suggesting that this c-Fos rhythm is 
likely driven by dark-light transition or onset of light, and not by an internal 
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circadian clock [123], A daily pattern in c-Fos expression in the ventral SPVZ 
was also found in diurnal species but, in contrast to nocturnal species, c-Fos 
labeling was higher during the dark phase [122-124], and this rhythm persisted 
under constant darkness [125], In contrast to the MPA, SPVZ, and DMH, the 
SCN showed the highest number of c-Fos-immunoreactive neurons during the 
light phase in both nocturnal and diurnal species [122, 123], 

In summary, the multi-unit recording and c-Fos studies indicate that daily 
rhythms of neuronal activity exist in the MPA, SPVZ, and DMH, and that 
many of these rhythms persist in constant darkness, indicating that they are 
endogenously driven, presumably by the SCN circadian clock. 


Lesions of the MPA 

Lesion studies indicate that the MPA has a relatively small influence on daily 
sleep-wake rhythms in animals housed under a light-dark cycle. In the rat, both 
radiofrequency [126] and excitotoxic [127-129] lesions of the MPA appeared to 
only slightly decrease the amplitude of sleep rhythms by reducing sleep amount 
during the light period (when nocturnal rats typically have most of their sleep). 
The animals were not tested under constant darkness in these studies. 


Lesions of the SP VZ 

There is good evidence that the ventral SPVZ plays a major role in the circa¬ 
dian regulation of sleep. Lu and colleagues [130] demonstrated that cell-specific 
lesions confined to the ventral SPVZ (which did not damage SCN neurons) 
markedly reduced the amplitude of circadian rhythms of sleep and locomotor 
activity in rats kept under constant darkness, but had smaller effects on body 
temperature, whereas lesions of the dorsal SPVZ primarily reduced the ampli¬ 
tude of circadian rhythms of body temperature but not of sleep and locomotor 
activity. Neither of these SPVZ lesions affected daily sleep amounts. Consistent 
with these results using an excitotoxin, small electrolytic lesions of the ventral 
SPVZ (sparing the SCN) caused a loss of circadian rest-activity rhythms with¬ 
out affecting body temperature rhythms [131]. Large electrolytic lesions in the 
SPVZ-paraventricular hypothalamic nucleus also severely disrupted circadian 
rest-activity cycles, but did not affect body temperature rhythms [132], The lack 
of an effect on body temperature rhythms with these large electrolytic lesions 
(which presumably included the dorsal SPVZ) appears to contrast with the 
disruption in body temperature rhythms resulting from restricted excitotoxic 
lesions of the dorsal SPVZ [130], It is possible that the recovery of circadian 
rhythms of body temperature may be observed when animals are monitored for 
a long period of time following surgery (30 days in a light-dark cycle followed 
by at least 30 days under constant darkness [132] versus 6 days in a light-dark 
cycle followed by only 6 days under constant darkness [130]). 
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Lesions of the DMH 

Like the SPVZ, the DMH appears to be critically involved in regulating circa¬ 
dian rhythms of sleep and wake. Chou and colleagues [109] showed that excito- 
toxic lesions of the rat DMH severely reduced the amplitude of circadian sleep 
rhythms when animals were housed in constant darkness. These lesions also 
drastically disrupted the circadian rhythms of locomotor activity and serum 
corticosteroid levels, but not the rhythms of body temperature or melatonin 
secretion. Consistent with the results from excitotoxic lesions, electrolytic le¬ 
sions of the DMH reduced the amplitude of daily rhythms of locomotor activ¬ 
ity and corticosterone [133, 134], In addition to disrupting circadian rhythms, 
excitotoxic DMH lesions reduced the total daily time spent in wakefulness or 
locomotor activity, corticosteroid secretion, and body temperature, suggesting 
an overall activational influence of DMH on behavioral state and autonomic 
functions [109], 

The DMH has also been implicated in food restriction-entrainable circadian 
rhythms. Circadian rhythms in behavioral and physiological variables can be 
phase-shifted or entrained by restricting daily food availability to a few hours 
during the rest phase (for a review see [135]), and lesions of the DMH can 
disrupt some, but not all, manifestations of daily food-anticipatory activity 
[120, 133], 

In summary, both the SPVZ and DMH appear to play an important role in 
circadian rhythms of sleep and wake, possibly by relaying the circadian signal 
from the SCN. More investigation is needed to determine any role of the MPA 
in the regulation of circadian sleep-wake rhythms. 


Indirect projections from the SCN to other sleep- and wake-regulatory cell 
groups: Are there segregated pathways? 

Although the present review is focused on the pathways from the SCN to the 
DRN and MRN, it should be pointed out that these pathways are part of the 
SCN’s widespread network, which projects indirectly via the MPA, SPVZ, and 
DMH to many nuclei of the sleep-wake regulatory system [68-70], Using the 
dual tract-tracing technique described above, we found that the wake-promot¬ 
ing orexin-containing neurons in the lateral hypothalamus and histaminergic 
neurons in the tuberomammillary nucleus [13] are well positioned to receive 
indirect projections from the SCN via the MPA, SPVZ, and DMH. The norad¬ 
renergic neurons in the locus coeruleus, involved in arousal and attention [13], 
may also receive indirect input from the SCN through the MPA and DMH, 
particularly to their medioventrally extending dendrites. The cholinergic groups 
in the basal forebrain (especially the substantia innominata-magnocellular 
basal nucleus) and the mesopontine tegmentum (especially the laterodorsal teg¬ 
mental nucleus), involved in cortical activation [13], are well-positioned to re¬ 
ceive indirect SCN input via the MPA and DMH, respectively. Sleep-active cell 
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groups in the ventrolateral and median preoptic nuclei [68, 69] are also likely to 
receive an indirect SCN input via the MPA and DMH and, to some extent, the 
SPVZ. Additionally, the ventrolateral preoptic nucleus receives a sparse direct 
projection from the SCN [18, 19]. Thus, the SCN may send indirect projections 
to multiple nuclei of the sleep-wake regulatory system, with overlap at the three 
proposed relay nuclei. 

The extent to which these indirect pathways might overlap at the cellular 
level in each relay nucleus is currently unknown. However, as sleep and wake 
are opposing and mutually exclusive states, it is likely that the indirect pathways 
are fairly well segregated. This segregation may start in the SCN, and there is 
anatomical and functional evidence to support this notion. Anatomically, SCN 
efferent projections are topographically organized with respect to the shell 
and core divisions (for reviews see [1, 14, 15]). Further, distinct sets of neurons 
within the SCN shell project to different neuronal populations in the paraven¬ 
tricular hypothalamic nucleus, which, in turn, project to sympathetic and para¬ 
sympathetic ganglia [136], Functionally, lesion and knife cut studies indicate 
that individual SCN projections to the presumed relay nuclei may differentially 
regulate circadian rhythms of sleep, body temperature, and hormones such as 
melatonin and corticosterone [109, 130-132], 

There is some evidence to suggest that the MPA and DMH have differ¬ 
ent functions in sleep-wake regulation. A primary role of the MPA may be to 
exert an inhibitory influence upon the wake-promoting system during sleep. 
Warming of the preoptic area resulted in an increase of the firing rates of sleep- 
active neurons in the MPA [137] and also a decrease in the firing rate of wake- 
active neurons in the lateral hypothalamus [138], basal forebrain [139] and, rele¬ 
vant to this review, the DRN [140], In contrast to the MPA, the DMH may 
mainly exert an excitatory influence upon the wake system. In support of this, 
lesions of the DMH not only decreased the amplitude of circadian sleep-wake 
rhythms, but also decreased the amount of wakefulness [109], whereas phar¬ 
macological activation of DMH neurons increased locomotor and autonomic 
activity [141], 

To add another level of complexity, in light of our findings that the MPA and 
DMH innervate both sleep- and wake-regulatory cell regions, it is possible that, 
during sleep, some MPA neurons inhibit wake-promoting neurons, while others 
excite sleep-promoting neurons. Conversely, during wakefulness, some DMH 
neurons may excite wake-promoting neurons, while others may inhibit sleep- 
promoting neurons. These functionally different neurons may use different 
neurotransmitters and, in fact, Chou and colleagues [109] showed that DMH 
neurons with projections to the wake-active orexin field contained mainly glu¬ 
tamate or thyrotropin-releasing hormone, whereas those that projected to the 
sleep-active ventrolateral preoptic nucleus were predominantly GABAergic. It 
is further possible that a single “relay” neuron may project to both wake- and 
sleep-promoting neurons through axonal branching and, even though the same 
neurotransmitter may be released, different pre- and postsynaptic mechanisms 
might result in opposing effects. 
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In summary, indirect pathways from the SCN to the sleep- and wake-regula¬ 
tory areas may be segregated at the levels of both the relay nuclei and the SCN. 
Functionally different SCN neurons might innervate the MPA, SPVZ, DMH 
and, possibly, different groups of neurons within each of these nuclei to pro¬ 
mote either wakefulness or sleep. 


The importance of indirect neuronal pathways from the SCN 

There are several potential advantages to the indirect pathways from the SCN 
to the sleep-wake regulatory system [14, 68, 72, 142], A major advantage is that 
the relays may provide opportunities for integrating the circadian message with 
other relevant information. It is known that certain internal and external stimuli 
can override the circadian message and alter the timing of sleep. For example, 
sleep deprivation during the rest phase can cause an increase in sleep during the 
active phase to allow for sleep recovery. Conversely, the daily restriction of food 
availability to only a few hours during the rest phase can induce an increase in 
activity in anticipation of meal [135], The integration, via a relay nucleus, of 
circadian signals from the SCN with internal and external stimuli may underlie 
adaptive responses of circadian sleep-wake cycles to relevant stimuli. 

Another advantage is that the relays may amplify the influence of the SCN. 
For example, ventrolateral preoptic GABAergic neurons and orexin-contain- 
ing hypothalamic neurons receive only sparse direct projections from the SCN, 
but may receive a stronger signal from the SCN through the apparently dense 
indirect projections. Furthermore, using the indirect circuits, the SCN could 
influence sleep-wake areas (including the DRN and MRN) that are not directly 
innervated by the SCN. Such widespread influence of the SCN would help en¬ 
sure robust circadian rhythms of sleep and wakefulness. 


Feedback projections from the DRN and MRN to the SCN 

In the sections above, we discussed neuronal pathways from the SCN to the 
DRN and MRN, and their potential role in transmitting the circadian message 
to the raphe nuclei. Yet, there is growing evidence that the communication be¬ 
tween the circadian and sleep-wake systems is not unidirectional but reciprocal 
and, as such, vigilance states may influence the timekeeping mechanisms in the 
SCN. Anatomical evidence in support of this notion is that the SCN receives 
afferent projections from a number of sleep-wake regulatory areas. With respect 
to serotonin, the SCN receives an indirect input from serotonergic neurons in 
the DRN, via the thalamic intergeniculate leaflet and dense innervation directly 
from serotonergic neurons in the MRN [56-58], The DRN and MRN also have 
reciprocal connections with each other [46,47, 143], These findings are summa¬ 
rized in Fig. 2. As the activity of the DRN and MRN serotonergic neurons is 
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clearly correlated with behavioral states, an interesting question is whether in¬ 
direct serotonergic projections from the DRN and direct serotonergic afferents 
from the MRN to the SCN may provide the SCN with information about the 
vigilance state of the animal to influence the circadian machinery in the SCN. 


Effects of behavioral arousal on circadian activity rhythms 

Feedback to the circadian clock regarding the vigilance state of the animal has 
been investigated by examining the effect of behavioral arousal and associated 
sleep loss on circadian activity rhythms (for a review see [144]). For example, 
2 h of running in a novel wheel [145] or 3 h of sleep deprivation by “gentle 
handling” [146, 147] during the usual rest phase (“subjective day”) caused dra¬ 
matic and enduring phase advances of circadian activity rhythms in hamsters. 

Several lines of evidence support a role for serotonin in mediating the phase 
shifts of circadian activity rhythms induced by behavioral arousal or sleep 
loss (for a review see [66]). For example, application of serotonin receptor 
5-HT 1A/7 agonists during the “subjective day” induced phase shifts in the cir¬ 
cadian rhythms of SCN neuronal firing in vitro [148], A 3-h in vivo perfusion 
of serotonin receptor 5-HT 1A/7 agonists into the SCN of hamsters pretreated 
with p-chlorophenylalanine (an inhibitor of serotonin synthesis that causes 
serotonin receptor hypersensitivity) during the “subjective day” induced phase 
advances in activity rhythms [149], Similar results were seen with electrical 
stimulation of the DRN or MRN, which induced serotonin release in the SCN 
[150-152], Wheel running or sleep deprivation during either the light phase or 
the “subjective day” also induced a ~50% increase in SCN serotonin levels [48, 
153], Conversely, selective lesion of serotonergic terminals in the SCN area by 
local microinjection of the neurotoxin 5,7-dihydroxytryptamine prevented the 
phase shifts of circadian activity rhythms in response to daily treadmill running 
schedules in mice [154, 155], These findings suggest that serotonin released in 
the SCN may mediate phase shifts of circadian rhythms in response to behavio¬ 
ral activation, and may participate in the vigilance state feedback loop to the 
circadian clock. 

There is, however, other evidence disputing the link between serotonin and 
arousal-induced phase shifts. For example, in contrast to the results from mice, 
hamsters bearing lesions of serotonergic terminals in the SCN area were still 
capable of phase shifting their circadian activity rhythms in response to wheel 
running during the “subjective day” [156], Similarly, systemic injections of vari¬ 
ous serotonin receptor antagonists failed to attenuate shifts induced by wheel 
running [157], 

These results suggest that, while serotonin may play a role in arousal-induced 
phase shifts, there may be some species differences and other neurotransmitters 
may also participate. One candidate is neuropeptide Y, which is present in af¬ 
ferent terminals in the SCN that originate in the thalamic intergeniculate leaflet 
[155, 158], which is in turn innervated by serotonergic neurons in the DRN. 
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Behavioral state-dependent activity of SCN neurons 

A number of studies have investigated how feedback information about vigi¬ 
lance states might influence the circadian clock by examining the correlation 
between sleep-wake state and neuronal firing rate in the SCN. The firing rates 
of SCN neurons were found to be strongly influenced by behavioral states 
and sleep loss. Glotzbach and colleagues [159] were the first to record the dis¬ 
charge rate of single SCN neurons in relation to the sleep-wake cycle using the 
highly challenging technique of combined single-unit and EEG/EMG record¬ 
ings in freely moving rats. Neurons within and very close to the SCN showed 
diverse discharge patterns across the sleep-wake cycle. Many cells were more 
active either during NREM sleep, or during wakefulness and REM sleep. Re¬ 
cently, Deboer and colleagues [160] used chronic EEG/EMG and multi-unit 
recordings, which allowed the recording of collective neuronal activity across 
many sleep-wake cycles, and showed that SCN neurons were less active during 
NREM sleep than during either wakefulness and REM sleep. This state-depen¬ 
dent discharge pattern was superimposed on circadian discharge rhythms. 

These state-dependent activity patterns of SCN neurons are intriguing, and 
it is yet to be determined whether these patterns are influenced by serotonin 
levels. The release of serotonin in the SCN is likely to be highest during wake¬ 
fulness and lowest during REM sleep, based on the known state-dependent 
patterns of firing rate of presumed serotonergic neurons and the serotonin lev¬ 
els in other forebrain sites [35, 36,44,45], In light of the evidence that serotonin 
inhibits the spontaneous firing of SCN neurons [161, 162], it is likely that, dur¬ 
ing wakefulness, any serotonergic inhibitory inputs to the SCN are overridden 
by presumably massive excitatory input that would activate wake-active SCN 
neurons. During REM sleep, however, serotonergic inhibition is expected to 
be turned off and may therefore allow for the activation of REM sleep-active 
SCN neurons. 

Interestingly, SCN neurons also respond to sleep loss with altered firing pat¬ 
terns. Multi-unit recordings in rats showed that the discharge of SCN neurons 
was somewhat suppressed (to -85% of baseline) during a 6-h sleep deprivation 
in the first half of the “subjective day”, and even more substantially suppressed 
(to -65% of baseline) during post-deprivation periods of up to 7 h [163], This 
decrease in firing paralleled the time course of the increase in slow-wave ac¬ 
tivity in the NREM sleep EEG (a marker of the homeostatic drive for sleep) 
following sleep deprivation. Sleep deprivation for 3 h has also been shown to 
increase the release of serotonin by -50% in the hamster SCN [153], In light of 
the inhibitory action of serotonin in the SCN (see above), it can be speculated 
that the suppression of SCN electrical activity following sleep deprivation may 
be triggered, at least in part, by an increase in SCN serotonin levels during 
sleep deprivation. These studies suggest that the activity of SCN neurons can 
be influenced by both basic sleep-wake states and a homeostatic signal regard¬ 
ing sleep need. 
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Effects of serotonin on the response of SCN neurons to light 

In addition to direct effects on SCN neuronal activity, serotonin can modulate 
the response of SCN neurons to light and thereby plays an important role in 
the photic entrainment of the circadian pacemaker in the SCN (for a review 
see [16]). Serotonergic axon terminals are found throughout the SCN but are 
particularly dense in the core region, which also receives dense retinal afferents 
[56, 85, 164], Systemic administration of serotonin receptor 5-HT 1A/7 agonists 
inhibited light-induced increases in firing rate of SCN neurons [162] and c-Fos 
expression in the SCN [165], and attenuated light-induced phase shifts in be¬ 
havioral circadian rhythms [166], Activation of 5HT 1B receptors located on reti¬ 
nal afferent terminals in the SCN inhibited both light-induced c-Fos expression 
in the SCN and light-induced behavioral phase shifts [167,168], These interac¬ 
tions between serotonin and photic input may be the substrate for interaction 
of light and arousal stimuli to influence the daily sleep-wake cycle, a topic that 
has yet to be investigated extensively using behavioral techniques. 

In summary, there is good evidence that the sleep-wake system sends feed¬ 
back information regarding vigilance state as well as sleep need to the SCN. 
Behavioral arousal and associated sleep loss can induce phase shifts in circa¬ 
dian activity rhythms and strongly alter the firing rates of SCN neurons, and 
serotonin may have a role in these effects. Thus, the information regarding sleep 
and wake states and sleep need may be conveyed to the SCN, at least in part, 
by serotonin through direct feedback projections from the MRN and indirect 
projections from the DRN. This feedback information may allow the circadian 
system to track the amount of sleep need and offset it against the obligatory 
circadian control of sleep-wake cycles. 


Conclusions and future directions 

The neuronal circuits responsible for the circadian regulation of behavioral 
states are only beginning to be understood. Given that the SCN, which func¬ 
tions as the dominant pacemaker for mammalian circadian rhythms, has only 
limited direct efferent projections to the sleep-wake regulatory system, it is 
highly likely that the SCN uses indirect efferent projections (as well as diffus¬ 
ible factors) to transmit circadian timing information. With a dual tract-tracing 
technique, we found that several hypothalamic nuclei, namely, the MPA, SPVZ, 
and DMH, are well positioned to relay SCN efferent projections to multiple 
nuclei of the sleep-wake system. The MPA and DMH may relay input straight 
from the SCN to the midbrain raphe nuclei, whereas the SPVZ may serve as an 
intermediary from the SCN to the DMH, which, in turn, projects to both the 
DRN and MRN. 
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Despite evidence for circadian rhythms in some aspects of serotonergic ac¬ 
tivity such as TpH levels and serotonin release, it remains to be demonstrated 
whether serotonergic (and non-serotonergic) neurons in the DRN and MRN 
show circadian discharge rhythms. Aston-Jones and colleagues [169] recorded 
the firing rates of neurons in the locus coeruleus (which, similar to neurons in 
the DRN and MRN, increase activity during wakefulness) in rats anesthetized 
at different time points during the light-dark cycle or under constant darkness. 
They were then able to demonstrate circadian variations in firing rate of locus 
coeruleus neurons without the confounding factor of behavioral activity. While 
this elegant technique could potentially introduce the confounding factor of 
anesthesia, it might be useful for characterizing the circadian nature of DRN 
and MRN neuronal firing. 

The co-injection technique that we used to study indirect projections from 
the SCN to the sleep-wake system offers an opportunity to concurrently exa¬ 
mine multiple targets of indirect projections. However, this technique does not 
provide any information regarding the relationship between SCN afferent fibers 
and projecting relay neurons. Additional experiments are therefore required to 
examine any synaptic connections within each potential relay nucleus between 
SCN afferents and neurons projecting to the DRN and MRN. One approach 
is to inject an anterograde tracer into the SCN and a retrograde tracer into one 
of these raphe nuclei, and to examine any synaptic interactions with electron or 
confocal microscopy. 

While there is some physiological evidence to support the idea that the pro¬ 
posed relays are important for circadian sleep-wake rhythms, critical experi¬ 
ments that would test the role of these relays and their projections to the DRN 
and MRN have yet to be conducted. It is important to examine the modulation 
of putative relay neurons by SCN afferents and, accordingly, assess the way in 
which these neurons may in turn modulate DRN and MRN neuronal activity 
(possibly in a circadian manner). One approach is to examine the effects of 
stimulation or inactivation of the SCN on the firing patterns of both relay and 
raphe neurons. Similarly, one can record the firing rates of DRN and MRN 
neurons and examine the effects of excitotoxic lesions of relay nuclei (which 
would affect all cell types), and chemical activation or blockade of receptors 
within relays for the neurotransmitters contained in SCN efferents, such as 
GABA (which would affect different cell types in relays). 

The SCN receives direct and indirect serotonergic projections from the MRN 
and DRN, respectively, and SCN neurons show robust state-dependent activity 
patterns. However, it remains to be determined whether serotonin (and other 
neurotransmitters of the sleep-wake system) contributes to the SCN’s state- 
dependent activity patterns. One way to address this would be to use extracel¬ 
lular recordings of SCN neurons and iontophoretic application of serotonergic 
receptor antagonists at different stages of the sleep-wake cycle to examine the 
effects on firing rate. 

This overview of the anatomical and functional relationships between the 
SCN circadian pacemaker and the sleep-wake regulatory system, with a focus 
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on the midbrain serotonergic pathways, highlights the complexity of the circa¬ 
dian regulation of behavioral states. To understand these relationships more 
fully is certainly an extremely interesting subject for future research. Regard¬ 
less of the mechanisms, however, it is highly likely that the reciprocal interac¬ 
tions between the circadian and sleep-wake systems are critical for ensuring the 
stable yet adaptive daily rhythms of sleep-wake cycles, a fundamental feature 
of life on Earth. 
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Abstract 

Serotonergic neurons located in the dorsal and median raphe nuclei innervate the whole 
neuraxis and are critically involved in a large number of physiological functions, including 
sleep. Derangements of the serotonergic system are suspected in several psychiatric disor¬ 
ders, including mood and anxiety disorders. A large body of data supports a prominent 
role of dopamine in cortical function. However, much less is known on the role of sero¬ 
tonin (5-HT) in the neocortex, despite a very dense serotonergic innervation of some areas, 
such as the frontal lobe. Among other 5-HT receptors, this area contains a high density 
of 5-HT 1A and 5-HT 2A receptors in the rodent, primate and human brains. Using double 
in situ hybridization, we reported on the presence of both receptor subtypes in a high 
proportion of pyramidal neurons and a smaller, yet significant proportion of GABAergic 
neurons. These data indicate that 5-HT can modulate the activity of cortical networks in 
a number of ways, including the activation of receptors on projection pyramidal neurons 
and on local inhibitory interneurons. 


Introduction 

Serotonin (5-hydroxytryptamine, 5-HT) is present in the central nervous system 
(CNS) of vertebrates and invertebrates, where it plays the role of a neurotrans¬ 
mitter and/or neuromodulator. 5-HT produces its effects through a variety of 
membrane-bound receptors, located in the CNS and peripheral nervous sys¬ 
tems and in non-neuronal tissues in the gastrointestinal tract, cardiovascular 
system and blood. 
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Within the CNS, the serotonergic system is involved in a large number of 
functions that result from its widespread innervation of the whole neuraxis. The 
axons of serotonergic neurons of the midbrain raphe nuclei reach almost ev¬ 
ery brain structure. Action potentials traveling along these axons release 5-HT, 
which can act on pre- and postsynaptic receptors, coupled to different signal 
transduction mechanisms. Up to 14 different serotonergic receptors exist, be¬ 
longing to six distinct classes of G protein-coupled receptor (GPCR) popula¬ 
tions, namely 5-HT,, 5-HT 2 , 5-HT 4 , 5-HT s , 5-HT 6 and 5-HT 7 , and a family of 
ligand-gated ion channels, 5-HT 3 [1,2], 

Given such a widespread innervation of the brain and the richness of sig¬ 
nals evoked by 5-HT, the serotonergic system is the target of many drugs used 
to treat brain diseases. For instance, most antidepressant treatments block the 
5-HT transporter and increase the extracellular (or synaptic) 5-HT concentra¬ 
tion and hence, they indirectly elevate the serotonergic tone at pre- and postsyn¬ 
aptic 5-HT receptors. This action is supposed to mediate the therapeutic effect 
of these drugs. Moreover, some anxiolytic drugs are 5-HT 1A receptor agonists 
and 5-HT, receptor antagonists are commonly used to treat emesis induced by 
anti-cancer treatments. 

On the other hand, drugs of abuse such as cocaine, amphetamine or MDMA 
(ecstasy) target monoaminergic transporters, including the 5-HT transporter. 
Hallucinogens like LSD, DOI, DOB or DOM are agonists of the 5-HT 2 re¬ 
ceptor family, whereas atypical anti-psychotics act as preferential antagonists 
of these receptors. Moreover, selective antagonists of 5-HT 2A receptors display 
anxiolytic and sleep-inducing properties. 

Among the various 5-HT receptors, the 5-HT, family has probably received 
the largest attention because of the large density in limbic (5-HT IA ) and motor 
(5-HT 1B ) areas and the various roles subserved by some of its members. Thus, in 
addition to being located postsynaptically to 5-HT axons, 5-HT 1A and 5-HT 1B 
receptors are autoreceptors in 5-HT neurons and therefore control the overall 
(5-HTj J or local (5-HT 1B ) activity of the system. 5-HT 1B receptors are also ter¬ 
minal heteroreceptors and control the release of various transmitters, including 
dopamine, glutamate, GABA and acetylcholine. Moreover, 5-HT 1A receptors 
are expressed in high density by different neuronal types (mainly pyramidal but 
also GABAergic) in the limbic system and in prefrontal cortex, which suggests 
an important role in the control of mood and emotions as well as in cognitive 
processes. An extensive review of the characteristics of the serotonergic system 
is beyond the scope of the present chapter. The reader is referred to several 
review papers dealing with the anatomy, physiology, neurochemistry and neu¬ 
ropharmacology of the 5-HT system [2-4], Here we review our current know¬ 
ledge of the localization of 5-HT receptor subtypes in the prefrontal cortex of 
rats, and human and non-human primates. 
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The prefrontal cortex: 5-HT localization 

There is growing evidence that the serotonergic pathways originating in the dor¬ 
sal and median raphe nuclei are critically involved in cortical function. 5-HT 
appears to play an important role in the development of the somatosensory 
cortex and formation of the barrel cortex. In adult brain, the axons of 5-HT 
neurons innervate a large number of cortical areas, including the entorhinal 
and cingulate cortices, which contain a moderate to high density of 5-HT re¬ 
ceptors. However, of all cortical regions, the frontal lobe is the richest area in 
serotonergic axons and 5-HT receptors. 

Yet, unlike dopamine, whose function in the mammalian cortex (mainly the 
prefrontal cortex) has been extensively studied over the last decade, the role of 
5-HT in the neocortex remains largely unknown. Indeed, the widespread local¬ 
ization of 5-HT receptors (particularly of the 5-HT 1A , 5-HT 2A and 5-HT 2C sub- 
types) and the high density of 5 HT axons (greater than in any other cortical 
area) suggest an important role in cognitive and emotional functions depending 
on prefrontal cortex activity. The scarce information available to date supports 
this view. Hence, the selective depletion of 5-HT in the orbitofrontal subdivi¬ 
sion of the monkey prefrontal cortex impairs learning flexibility [5], Moreover, 
as previously observed for dopamine D1 receptors [6], the blockade of 5-HT 2A 
receptors in dorsolateral prefrontal cortex avoids the increase in neuronal activ¬ 
ity during a working memory task [7], and recent work associates allelic vari¬ 
ants of this receptor with memory capacity in humans [8], Furthermore, hal¬ 
lucinogens like LSD or DOI are 5-HT 2A receptor agonists, which also suggests 
a role of 5-HT in the processing of external (sensory) and internal information 
through the activation of 5-HT 2A receptors. On the other hand, 5-HT 1A agonists 
display anxiolytic/antidepressant activity in animal models [9], whereas 5-HT 1A 
receptor antagonists reverse drug-induced cognitive deficits [10-12], Indeed, 
key background information for the interpretation of physiological and behav¬ 
ioral data concerning the cortical 5-HT system is the regional and cellular lo¬ 
calization of the 5-HT receptors. 


5-HT 1a and 5-HT 2A receptor localization in mammalian cortex 

5-HT 1A receptors are particularly enriched in the medial prefrontal cortex, en¬ 
torhinal cortex and to a lesser extent, cingulate and retrosplenial cortices. Out¬ 
side the cortex, they are densely expressed in the hippocampus, septum and the 
raphe nuclei. In the latter location the receptor is almost exclusively expressed 
by 5-HT neurons, where it functions as an autoreceptor, and it localized in the 
plasma membrane of perikarya and dendrites [13], Several studies have exam¬ 
ined the localization of 5-HT in the cortex. 5-HT 1A receptors have been most fre¬ 
quently labeled using the selective agonist [ 3 H]-8-OH-DPAT, more recently with 
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an antagonist, such as [ 3 H]-WAY 100635, or less frequently with [ n C]-NAD-299 
([R]-3-A, A-dicyclobutylamino-8-fiuoro-3,4-dihydro-2H-l -benzopyran-5-car- 
boxamide) all giving a qualitatively identical distribution of binding sites in the 
brain of several species. High densities of 5-HT 1A receptor binding sites are ob¬ 
served in the rat CA1 and CA3 fields of the hippocampus, molecular layer of den¬ 
tate gyrus, septal nuclei, entorhinal cortex, some nuclei of the amygdala, dorsal 
raphe nucleus and interpeduncular nucleus [14-16], In human and monkey brain 
[17-23], the anatomical distribution of 5-HT 1A receptors is also heterogeneous 
and quite similar for the different radioligands used. 

Immunohistochemical localization of 5-HT 1A receptors has been accom¬ 
plished by several groups with different antibodies [13, 24-29], The highest 
5-HT 1A receptor-like immunoreactivity is detected in some septal nuclei, hippo¬ 
campus, frontal and entorhinal cortex, dorsal raphe nucleus and interpeduncu¬ 
lar nucleus. 

The distribution of 5-HT 1A mRNA-containing cells obtained by in situ hybrid¬ 
ization histochemistry has been studied in rat [15, 16, 30], in monkey [20] and 
human brain [31-33], High levels of 5-HT 1A mRNA are observed in areas such 
as dorsal raphe nucleus, claustrum, some septal nuclei, hippocampus, entorhinal 
cortex, and interpeduncular nucleus. Lower levels are visualized in other corti¬ 
cal areas, olfactory system, and brainstem nuclei. In general, the distribution and 
abundance of the mRNA paralleled those of the radiolabeled binding sites and 
of the 5-HT 1A -like immunoreactivity, indicating that 5-HT 1A receptors present 
mainly somatodendritic localization both on serotonergic and non-serotonergic 
neurons. 

Early studies using receptor autoradiography and in situ hybridization en¬ 
abled to identify the presence of various 5-HT receptors in cortical areas, no¬ 
tably the 5-HT 1A , 5-HT 2A and 5-HT 2C subtypes [14, 15, 34, 35], Further studies 
identified the presence of other receptor subtypes, yet in lower density than 
these ones. 

PET scan studies using a radiolabeled selective antagonist (["C]WAY- 
10063 5) have shown a totally similar distribution in human brain, with an en¬ 
richment of the signal in the temporal and frontal lobes, cingulate cortex and 
the midbrain raphe nuclei [36], Interestingly, as also observed in rats, there is 
a marked rostro-caudal negative gradient in the abundance cortical of 5-HT 1A 
receptors, with the largest abundance in prefrontal cortex. 

Initial studies on 5-HT 2A receptor localization used high-affinity, but not se¬ 
lective, radioligands such as the antagonists [ 3 H]spiperone, [ 3 H]ketanserin, [ 12S I]- 
7-amino-8-iodo-ketanserin ([ 125 I]AMIK), [ 3 H]RP62203, or the agonists [ 3 H]LSD, 
[ 3 H]DOB or [ 125 I]DOI [34, 37-45], Many of these compounds have been shown 
later to present high affinity for other receptors, particularly for 5-HT 2C recep¬ 
tors and other binding sites. The development of [ 3 H]MDL100,907 (also called 
Ml00907), a highly potent selective antagonist with subnanomolar affinity for 
5-HT 2A receptors [46, 47], allowed the selective detection of these receptors by 
quantitative receptor autoradiography [48-51], 
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A comparative study of the distribution in the rat brain of 5-HT 2A receptor as 
labeled with four different high-affinity ligands [50] shows that [ 3 H]MDL100,907 
appears to be a truly selective 5-HT 2A radioligand, which allows for the direct vi¬ 
sualization and quantification of these sites without the need for blockade of ad¬ 
ditional sites that are labeled by all the other radioligands used until now to label 
these receptors. Similar selectivity has been found when using this ligand to label 
5-HT 2A receptors in the primate and human brain. Unfortunately, this ligand is no 
longer commercially available. 

The distribution of 5-HT 2A binding sites in all the mammalian species studied 
until now showed an enrichment of these sites in the neocortex, which is the brain 
region with the highest densities of 5-HT 2A receptors. In rat brain high densities 
of 5-HT 2A receptors are located mainly in layer Va of cortex [52], In human brain, 
these receptors are seen mainly in three layers, I, III and V [48] and in all six corti¬ 
cal layers in monkey brain [51]. 

The development of antibodies against 5-HT 2A receptor peptides allowed the 
study of the brain distribution of the receptor protein by immunohistochemistry. 
Using a polyclonal antibody against a receptor peptide [53], 5-HT 2A receptor im- 
munoreactivity in the rat brain has been found in several brain areas, especially 
in layers II-VI of neocortex. Few 5-HT 2A receptor-immunoreactive cells are pres¬ 
ent in the diencephalon, midbrain and hindbrain. Most of the cells in the cortex 
display a pyramidal morphology [54], Using two polyclonal antibodies, Hamada 
and coworkers [55] have also described a localization of the 5-HT 2A -positive neu¬ 
rons in rat brain very similar to the one previously described. These authors found 
5-HT 2A immunoreactivity also in glial cells. Using a monoclonal antibody raised 
against the entire N-terminal region of 5-HT 2A receptor, Cornea-Hebert et al. [56] 
found somatodendritic and axonal 5-HT 2A immunoreactivity, cytoplasmic rather 
than membrane bound, in most of the brain regions analyzed by the two pre¬ 
viously discussed publications. In primate cerebral cortex, 5-HT 2A receptor im¬ 
munoreactivity is detected in layers II—III and V-VI [57], In all cortical regions, 
pyramidal cells represented the majority of the immunoreactive cells. Some recent 
reports identify dopaminergic cells in the midbrain showing 5-HT 2A immunoreac¬ 
tivity in rat [58] and in human brain [59], 

The presence and distribution mRNA for 5-HT 2A receptors have been deter¬ 
mined in the rat brain [35, 60-63], in the primate brain [51, 64].and in human 
brain [31, 32, 64], 5-HT 2A receptor mRNA is detected in rat caudate-putamen, 
substantia nigra, and pontine nuclei, but it is absent from these regions in monkey 
and human brains. In contrast, other regions such as the habenular complex, para- 
bigeminal nucleus and ventral tegmental nucleus present higher 5-HT 2A receptor 
mRNA labeling in monkey brain than in rat brain. 5-HT 2A receptor mRNA is 
present in the prefrontal cortex of the rat brain [35], being more often expressed 
in glutamatergic cells than in GABAergic cells [30], In human brain 5-HT 2A re¬ 
ceptor transcripts are visualized in cortical layers III and V [31, 32], whereas in 
monkey brain 5-HT 2A receptor mRNA has been detected in layers III, IV and 
upper V [51]. 
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Likewise, the neocortex of rodent, primate and human brains shows a large 
abundance of 5-HT 2A receptors, with an enrichment in frontal regions [31, 
35, 48, 49, 65], Lower abundances are found in ventro-caudal part of CA3, 
medial mammillary nucleus, striatum (dorsal and ventral) and several brain¬ 
stem nuclei [31, 35, 49], As for 5-HT 1A receptors, there is a good agreement 
between the autoradiographic and in situ hybridization signals, which indicates 
that the receptor is expressed mainly in the somatodendritic region. Similar 
regional distributions have been reported in human brain using the selec¬ 
tive antagonist ligand Ml00907 in vivo (PET scan) or in vitro (autoradiography) 
[48]. 

5-HT 1A and 5-HT 2A receptors are present in a high proportion of cells in 
some cortical regions. Double in situ hybridization studies, to label the cellular 
phenotype and the respective receptor mRNA, have shown that around 50% 
of the pyramidal neurons (labeled with the vGluTl mRNA) and 20-30% of 
the GABAergic intemeurons (labeled with GAD65/67 mRNA) express 5-HT 1A 
and/or 5-HT 2A receptor mRNAs in various areas of the rat prefrontal cortex 
[30] (Fig. 1 and Tab 1). In the different layers of monkey and human prefrontal 
cortex, 5-HT 2A receptor mRNA is found in higher percentage of the pyramidal 
neurons, 60-100%, and in 13-34% of the GABAergic cells [64] (Figure 2 and 
Table 2). 

The abundant co-expression raises questions about the physiological role of 
the simultaneous occurrence of inhibitory (5-HT 1A ) and excitatory (5-HT 2A ) re¬ 
ceptors responding to 5-HT in the same cortical neurons. Various hypotheses 
have been examined [65, 66] but perhaps one of the most convincing explana¬ 
tions is the putative segregation of both receptors in different cellular com¬ 
partments. Thus, immunohistochemical studies by several groups consistently 
show a predominant location of 5-HT 2A receptors in the apical dendrites (and 
to a lower extent, cell bodies) of cortical pyramidal neurons [57, 67-69], How¬ 
ever, there is a considerable disagreement in regards to the location of cortical 
5-HT 1A receptors, due to the use of different antibodies. A homogenous labeling 
of cell bodies and dendrites was initially reported [70], but more recent studies 
in rodent, primate and human brain using a different antibody [28] show the 
exclusive labeling of the axon hillock of pyramidal neurons [71-73], This loca¬ 
tion suggests that 5-HT would be able to establish axo-axonic contacts with py¬ 
ramidal neurons similar to those established by chandelier interneurons, which 
potently suppress the generation of action potentials by activating GABA a re¬ 
ceptors in the same location. In this way, 5-HT axons reaching apical dendrites 
would be able to modulate glutamatergic inputs onto pyramidal cells via so¬ 
matodendritic 5-HT 2A receptors [74, 75], whereas those reaching axon hillocks 
might act as switches controlling the generation of nerve impulses through the 
activation of 5-HT 1A receptors. However, the controversy on the precise cellular 
localization of 5-HT 1A receptors remains to be solved. 
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Fig. 1 Localization of 5-HT 1A and 5-HT 2A receptor mRNAs in the rat prefrontal cortex. 
Autoradiographic localization of the mRNAs coding for 5-HT 1A (a) and 5-HT 2A (b) re¬ 
ceptors of emulsion-dipped rat coronal sections at two enlargements. Note the abundant 
presence of cells expressing both receptors in layers II-V. (b) and (f) show the presence 
of a large number of cells containing 5-HT 1A and 5-HT 2A receptor transcripts in cingu¬ 
late (ACAd) and prelimbic (PL) cortex. Cells in deep layers (VI) express preferentially 
5-HT 1A receptor mRNA. Glutamatergic cells expressing either 5-HT 1A (c) or 5-HT 2A (d) 
and GABAergic cells expressing either 5-HT 1A (e) or 5-HT 2A (f) Bar: 1 mm in (a,b), 26 pm 
in (c-f) 
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Table 1 Proportion of projection (pyramidal) and local network (GABAergic) neurons 
expressing the mRNAs encoding 5-HT 1A and 5-HT 2A receptors. 

Pyramidal neurons GABAergic neurons 


5-HT 1A 5-HT 2A 5-HT ia 5-HT 2A 

mRNA mRNA mRNA mRNA 


MOs 

ACAd 


54 ± 4 60 ± 2 

54 + 3 66 ± 5 

61+2 51 ±3 

40 ±4* 12 ± 1*" 

63 + 6 81 ± 3** 

60 + 2 50 ± 3 

54 + 3 26 ± 3* 


28 ± 6 28 ± 10 

22 ± 4 32 ± 2 

20 ± 1 34 ± 1 

22 ± 4 22 ± 3 

24± 1 24 ± 2 

21 ± 6 24 ± 2 

23 ±4 11 ± 3 ++ 


Data are means of three rats and represent the percentage of the counted cells expressing 
the mRNAs of each 5-HT receptor in pyramidal (vGluTl mRNA-positive) and GABAergic 
(GAD mRNA-positive) cells. 

MOs, secondary motor area; ACAd, dorsal anterior cingulate area; PrL, prelimbic area; 
ILA, infralimbic area; PIR, piriform cortex; TT, tenia tecta. Layer VI denotes deep areas of 
the sensorimotor cortex at prefrontal level. 

*p<0.05 vs PrL, TT and PIR; **p<0.05 vs the rest of areas, except layer Via (p=0.9); 
***p<0.05 vs the rest of areas; +p<0.05 vs the rest of areas except ILA; ++p<0.05 vs ACAd 
and PrL (Tukey test post-ANOVA). 

Data from [30], 


Table 2 Proportion of projection (pyramidal) and local network (GABAergic) neurons 
expressing 5-HT 2A receptor mRNA in human and monkey prefrontal cortex Area 9. 



Pyramidal neurons 


GABAergic neurons 

Layer 

Monkey 

Human 

Monkey 

Human 

I 

II 

88 ± s 

96 ±6 

18 + 2 

13 ±4 

III 

100 ±0 

98 ±2 

19 ±3 

19 ± 12 

IV 

94 ±2 

95 ± 7 

19 ±7 

13 ±10 

V 

100 ±0 

95 ±4 

24 ±6 

21 ±8 

VI 

61 ±5 

75 ± 10 

34+14 

17 ± 11 


Data are means of three human control cases and six monkeys and represent the percentage 
of the counted cells expressing the mRNAs of each 5-HT receptor in pyramidal (vGluTl 
mRNA-positive) and GABAergic (GAD mRNA-positive) cells. Data from [64], 
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5-HT 1B and 5-HT m receptors 

5-HT 1B receptors are one of the most abundant 5-HT receptor subtypes in the 
brain. In the rat they have been selectively visualized by receptor autoradiogra¬ 
phy with [ 3 H]CP96501 [76], [ 125 I]ICYP in the presence of the appropriate block¬ 
ing drugs [77] or with [ 3 H]GR125743. Using [ 125 I]GTI and blocking conveniently 
its binding to the rat 5-HT 1B receptors [78], rat5-HT 1D receptors were selectively 
visualized in rat brain but at lower densities in areas rich in rat 5-HT 1D receptors. 
Both 5-HT 1B and 5-HT 1D receptors are localized in the same structures of the rat 
brain: in substantia nigra pars reticulata, entopeduncular nucleus, globus palli- 
dus, ventral pallidum, caudate-putamen, subthalamic nucleus, ventral tegmental 
area, olivary pretectal nucleus, nucleus of the optic tract, superior colliculus and 
frontal cortex. The localization of human 5-HT 1B and human 5-HT 1D receptors 
by receptor autoradiography in human brain has been examined with different 
radioligands: [ 3 H]5-HT [79, 80], [ 3 H]5-HT and [ 125 I]GTI [77], [ 3 H]alniditan [81], 
[ 3 H]sumatriptan [82, 83] and [ 3 H]GR125743 [84], In general, lower levels of hu¬ 
man 5-HT 1D compared to human 5-HT 1B and receptor binding sites are detected 
in the different human brain areas. The highest densities of binding sites are found 
in different components of the basal ganglia, ventral pallidum, substantia nigra, 
nucleus accumbens, globus pallidus, caudate nucleus, and putamen, and in several 
cortical areas. This localization points to the possible involvement of these two 
receptors in the modulation of the in- and output of the basal ganglia, known to 
be involved in motor functions, and of the visual and olfactory systems. Relevant 
densities of human 5-HT 1B receptors are found in the pars caudalis of the spinal 
trigeminal nucleus and substantia gelatinosa of the cervical spinal cord, key con¬ 
trol pain areas. 

Immunohistochemical localization has been accomplished only for rat 5-HT 1B 
receptors with antibodies raised against synthetic peptides corresponding to 
residues of the third cytoplasmic loop [13, 85, 86], The highest 5-HT 1B receptor 
immunoreactivity in rat brain is detected in the substantia nigra pars reticulata, 
globus pallidus and dorsal subiculum. In addition, moderate immunoreaction is 
found in the entopeduncular nucleus, superior colliculus superficial gray layer, 
the caudate-putamen and the deep nuclei of the cerebellum. This distribution 
matched perfectly that previously described from radioligand binding studies 

The distribution of rat 5-HT 1B and rat 5-HT 1D receptor mRNA-contain- 
ing cells has been studied by in situ hybridization histochemistry in mouse [87], 
rat [77], guinea pig [88], monkey [89] and human [32, 89, 90] brain. In rat brain 
high levels of both rat 5-HT 1B and rat 5-HT 1D receptor mRNAs are found in the 
caudate-putamen. In contrast, no mRNA is expressed in the globus pallidus 
and substantia nigra, although these structures reveal the highest levels of rat 
5-HT 1B receptor binding sites. In the hippocampus, 5-HT 1B receptor mRNA is 
localized in the cell bodies of pyramidal cells of the CA1 field. In the cerebel¬ 
lum, this receptor is expressed in the Purkinje cells, which display no receptor 
binding sites on their cell bodies. Conversely, moderate binding is found in the 
deep nuclei of the cerebellum, the main projection zone of the Purkinje cells. 
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Fig. 2 Cellular localization of 5-HT 2A receptors in monkey prefrontal cortex. Autoradi¬ 
ographic localization of the mRNAs coding for 5-HT 2A receptors (a, d), vGluTl (b, e), 
and GAD65/67 (c, f) in monkey prefrontal cortex. Brodmann areas are defined in (b), 
according to Paxinos et al. [107], The different layers are indicated by roman numbers. 
5-HT 2A receptor mRNA is expressed in glutamatergic (g) and GABAergic cell populati¬ 
ons in monkey prefrontal cortex (h). High magnification bright field microphotographs 
of emulsion-dipped sections of the monkey layer III of the prefrontal cortex simulta¬ 
neously showing the different mRNAs visualized by double in situ hybridization using 
33 P-labeled oligonucleotides complementary to the mRNA coding for serotonin receptor 
5-HT 2A , (clusters of dark silver grains) with digoxigenin-labeled oligonucleotides (dark 
precipitate) for vGluTl mRNA (glutamatergic cells) (g), or GAD65/67 mRNA (GA¬ 
BAergic cells) (h). WM: white matter. Bars: 1 cm (a-c); 8 mm (D-F); 46 pm (g, h). 
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Rat 5-HT 1B receptor mRNA is also detected in the dorsal raphe. Moderate hy¬ 
bridization levels are obtained in amygdala, hypothalamus, visual system, cortex 
and pons. Concerning the sites of expression 5-HT 1D receptor mRNA, these are 
scantly distributed in other rat brain areas and show very weak signal. They in¬ 
clude primary olfactory cortex, nucleus accumbens, lateral mammilary nucleus, 
red nucleus, dorsal raphe nucleus and medial vestibular nucleus. 

In human brain, the highest expression levels of 5-HT 1B receptor mRNA are 
located in the caudate and putamen. Expression is also observed in layer V of the 
cortex, in Purkinje cells of the cerebellum. 5-HT 1B and 5-HT 1D receptor mRNAs 
are found in neurons within the human dorsal raphe nucleus. 

The comparison of autoradiographic, in situ hybridization and immunohis- 
tochemcial studies revealed that 5-HT 1B receptors are located both presynapti- 
cally (i.e., on 5-HT axons) and postsynaptically to 5-HT neurons, mostly on 
axons of intrinsic neurons of the basal ganglia [13]. However, their preferen¬ 
tial distribution in the basal ganglia and hippocampal formation ([91]; see also 
above references) does not match the distribution of 5-HT fibers, as assessed 
with 5-HT or SERT (serotonin transporter) immunoreactivity. This, together 
with the negative coupling of 5-HT 1B receptors to adenylate cyclase and its abil¬ 
ity to negatively modulate the release of several neurotransmitters [92] suggests 
that 5-HT 1B receptors play the role of autoreceptors in 5-HT neurons and hete¬ 
roreceptors in other neuronal phenotypes. 

Thus, presynaptic 5-HT 1B autoreceptors represent a small proportion of the 
entire population of 5-HT 1B receptors in the brain since the lesion of 5-HT 
neurons does not generally result in a reduction of their density [93], Notwith¬ 
standing the low density of cortical 5-HT 1B receptors seen by autoradiography, 
electrophysiological studies have identified 5-HT 1B receptor-mediated actions 
in the cingulate cortex of the rat [94], 


Other cortical 5-HT receptors 

The two other members of the 5-HT, family (5-HT 1E and 5-HT 1F receptors) are 
also present in cortex, particularly entorhinal cortex, yet their low abundance 
and the lack of selective pharmacological tools have hampered the study of 
their actions on cortical neurons. 

5-HT 2B receptors are expressed in a very low density in the brain. In con¬ 
trast, 5-HT 2C receptors (formerly named 5-HT lc receptors) are highly expressed 
in the choroid plexus (where they were initially identified), various cortical ar¬ 
eas, particularly the prefrontal cortex, the limbic system (nucleus accumbens, 
hippocampus, amygdala) and the basal ganglia (caudate nucleus, substantia 
nigra). 5-HT 2C receptors are also expressed in the human cortex, yet their abun¬ 
dance relative to other brain areas appears to be lower than in rat brain [95], 
Interestingly, immunohistochemical studies suggest that cortical 5-HT 2C recep¬ 
tors are mainly expressed in pyramidal neurons [95], yet more recent data using 
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a different antibody indicate that more than 50% of the 5-HT 2C receptor im- 
munoreactivity is present in GABAergic neurons [96], 

5-HTj receptors are moderately abundant in the neocortex and other telece- 
phalic regions, such as the olfactory cortex, the hippocampus and the amygdala. 
Interestingly, most cortical 5-HT 3 receptor mRNA is located in GABAergic 
interneurons, as assessed by in situ hybridization [97, 98], These are calbindin- 
and calretinin- (but not parvalbumin-) containing neurons and are located in 
superficial cortical layers (I—III) [97, 98], 

5-HT 4 receptors are abundant in the olfactory tubercle, some structures of 
the basal ganglia (caudate putamen, ventral striatum), medial habenula, hip¬ 
pocampal formation and amygdala. The neocortex contains low levels of the 
5-HT 4 receptor and its encoding mRNA, as assessed by autoradiography and 
in situ hybridization, respectively [99-101], However, more recent studies using 
double in situ hybridization suggest that a moderate proportion (-15%) of py¬ 
ramidal neurons in the prefrontal cortex contain the 5-HT 4 receptor transcript 
(Vilaro et al., unpublished observations). 

5-HT s receptors are the less well understood 5-HT receptors. The 5-HT 5A re¬ 
ceptor is present in rodent and human brain, but the 5-HT SB receptor is absent 
in human brain. The 5-HT SA receptor mRNA is found in relative high levels in 
the hippocampus, the medial habenula and the raphe but is absent in cortex. 
The occurrence of the receptor in the midbrain raphe, where the cell bodies of 
5-HT neurons are located raises the possibility that it may directly or indirectly 
influence the activity of 5-HT neurons. On the other hand, the 5-HT 5B receptor 
mRNA is present throughout the rat brain, with higher levels in the hippocam¬ 
pus, hypothalamus, pons and cortex [102], 

The richest brain areas in 5-HT 6 receptor mRNA are the ventral striatum 
and adjacent areas (nucleus accumbens, olfactory tubercle, islands of Calleja) 
and the caudate-putamen. High levels of 5-HT 6 receptor mRNA are also found 
in the hypothalamus and the hippocampus, whereas the cerebral cortex, the 
substantia nigra, and the spinal cord contain moderate levels of the transcript 
[103], Immunohistochemical studies have confirmed a similar distribution of 
the receptor protein, although the prefrontal cortex shows a labeling density 
greater than that of the mRNA and similar to that of the hippocampus [104], 
Finally, 5-HT 7 receptor mRNA is localized to discrete regions of the rodent 
brain. Higher levels are present in the thalamus and the hippocampus, whereas 
moderate levels are seen in the septum, the hypothalamus, the centromedial 
amygdala and the periaquaductal gray. Autoradiographic studies indicate the 
presence of a similar distribution of the binding sites, in the cortex, septum, 
thalamus, hypothalamus, centromedial amygdala, periaquaductal gray, and su¬ 
perior colliculus [105], Also, recent studies show a similar distribution in hu¬ 
man brain [106], Interestingly, the 5-HT 7 receptor is also localized in the raphe 
nuclei in both rodent and human brain, which has raised interest as a potential 
new mechanism to control the activity of the ascending 5-HT systems. 

In summary, 5-HT released from axons innervating the cerebral cortex can 
modulate the activity of cortical neurons through several distinct receptors. 
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However, with few exceptions (see above), little is known about the cellular 
phenotype of the neurons expressing 5-HT receptors, their precise distribution 
in cortical layers and the proportion of neurons of each type (e.g., pyramidal, 
stellate or GABAergic neurons) that express each receptor. The knowledge of 
these data is deemed important to identify the cellular elements and local cir¬ 
cuitry involved in the cortical actions of 5-HT. 
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Abstract 

Serotonin (5-hydroxytryptamine, 5-HT) is probably unique among the monoamines in that 
its effects are mediated by as many as 13 distinct G protein-coupled receptors and several 
ligand-gated ion channels (5-HT 3 ). These receptors are divided into seven distinct classes 
(5-HT, to 5-HT,) largely on the basis of their structural, transductional and operational 
characteristics. While this degree of physical diversity clearly underscores the physiologi¬ 
cal importance of serotonin, evidence for an even greater degree of operational diversity 
continues to emerge. 


Introduction 

Serotonin (5-hydroxytryptamine, 5-HT) produces its effects through a variety 
of membrane-bound receptors both in the central (CNS) and the peripheral 
nervous system (PNS) as well as in a number of non-neuronal tissues [e.g. gas¬ 
trointestinal (GI) tract, cardiovascular system and blood], 5-HT is one of the 
oldest neurotransmitters/hormones in evolution, estimated >800 Mio years; 
this may explain why 5-HT interacts with such a diversity of receptors of the 
G protein-coupled family and the ligand-gated family, similarly to acetylcho¬ 
line, GABA or glutamate, but with more receptor subtypes and a larger diver¬ 
sity at play. Enteramine was isolated from the gut in the 1930s, and rediscov¬ 
ered in the 1940s in the blood and called serotonin, based on its vasoconstrictor 
features; eventually it was found that enteramine and serotonin were the same 
entity, namely 5-HT. 

The subdivision of 5-HT receptors started in the 1950s, when it was 
realized that the effects of 5-HT in the guinea pig ileum were blocked in part 
by morphine (M), and in part by dibenzyline (D). Gaddum and Picarelli [1] 
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proposed two receptor classes, 5-HT M and 5-HT D. Obviously now, neither M 
nor D are selective for any receptor target, but the concept was correct. In 1976, 
in radioligand-binding studies using [ 3 H]5-HT and [ 3 H]lysergic acid (LSD), 
Fillion and colleagues [la] suggested the presence of 5-HT receptors in brain. 
Then in 1979, Peroutka and Snyder [2] characterized two distinct brain 5-HT 
binding sites, using [ 3 H]5-HT, [ 3 H]spiperone, and [ 3 H]LSD. These sites were 
named 5-HTj and 5-HT 2 , both labeling with [ 3 H]LSD. However, Gaddum’s M 
receptor was still distinct from the 5-HT, and 5-HT 2 receptors in both function 
and distribution, whereas the D receptor resembled pharmacologically the 
5-HT 2 binding site. Thus, Bradley and colleagues [3] proposed the existence three 
families of 5-HT receptors, named 5-HTj-like (there was already suggestions 
for diversity of this group), 5-HT 2 and 5-HT 3 , the latter corresponding to the M 
receptor. The scheme, based primarily on functional criteria, represented a useful 
classification framework. With the increasing application of radioligands, 
autoradiography and second messenger systems in the mid 1980s, subtypes of 
5-HTj receptor binding sites were indeed further characterized (5-HT 1A 1B 1C ). 
It became evident, however, that the 5-HT lc receptor would be better classified 
within the 5-HT 2 family, due to similar pharmacological profiles and second 
messenger features, thus suggesting the existence of 5-HT 2 receptor subtypes 
as well. Yet another 5-HT receptor was identified in the mid 1980s in the GI 
tract, heart and brain, termed 5-HT 4 . In 1988, the molecular biology era started 
with the cloning of the 5-HT 1A receptor. Rapidly, the most known but also some 
unsuspected 5-HT receptors were cloned. This work led to the identification of 
a number of “new” receptors, devoid of immediate physiological counterparts. 
Tentatively termed 5-HT 1E , 5-HT 1F , 5-HT 2F , 5-HT 5A , 5-HT SB , 5-HT 6 , and 
5-HT 7 , they required integration into an acceptable classification scheme. 
Thus, the Serotonin Club Receptor Nomenclature Committee proposed a new 
nomenclature system based on operational, structural and transductional 
information [4], These principles were subsequently applied to a number of 
receptor families by the newly created Receptor Nomenclature Committee 
of the International Union of Pharmacology (NC-IUPHAR) (Tab. 1). The 
current classification [5, 6] is still being progressively adapted to incorporate 
new information, obtained with both recombinant and native receptors, and 
favors an alignment of nomenclature with the human genome to avoid species 
differences [7, 8], As of today, seven families of 5-HT receptors are recognized 
based on pharmacology, transduction and structure. There is at least one 
orphan receptor, called 5-HT 1P by Mike Gershon and colleagues, present in 
the gut, which does not equate with the pharmacology of any of the cloned 
receptors [5], 

With the exception of 5-HT 3 receptors, (ligand-gated ion channels), 5-HT 
receptors belong to the G-protein coupled receptor (GPCR) superfamily and, 
with at least 13 distinct members, represents one of the most complex families 
of neurotransmitter receptors. 
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Table 3 5-HT 5 6 7 receptor nomenclature proposed by the NC-IUPHAR Subcommitte 
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5-HTj receptors 

The 5-HTj receptor class comprises five receptors (5-HT 1A , 5-HT 1B , 5-HT 1D , 
5-ht 1E and 5-HT ir ) which, in humans, share 40-63% overall sequence identity 
and couple somewhat preferentially to G i(0 to inhibit cAMP formation. The 
5-ht 1E receptors are given a lower case appellation to stress that the correspond¬ 
ing endogenous receptors with a physiological role have not yet been firmly 
established. In contrast, 5-HT 1A , 5-HT 1B 5-HT 1D and 5-HT 1F receptors have 
been demonstrated functionally in a variety of tissues. The 5-HT lc designation 
is vacant, as the receptor was renamed 5-HT 2C , due to structural, operational 
and transductional similarities with the 5-HT 2 receptor subclass [5], The 5-ht 1E 
receptor is apparently absent from mice and rats, but has been reported to be 
present in guinea pig brain [9], 


5-HT 1A receptors 

The human 5-HT 1A receptor is located on chromosome 5qll.2-ql3. 5-HT 1A 
receptors are largely distributed throughout the CNS, but are also present in 
the PNS. In the raphe nuclei, they are somatodendritic and act as autorecep¬ 
tors to inhibit cell firing; postsynaptic 5-HT 1A receptors are present in limbic 
structures, particularly the hippocampus. 5-HT 1A receptors mediate neuronal 
hyperpolarization, via G-protein coupled K + channels. In the GI tract, 5-HT 1A 
receptors on the guinea pig myenteric plexus act as inhibitory modulators of 
fast excitatory postsynaptic potentials. The 5-HT 1A receptor consists of a single 
polypeptide chain of 421^122 amino acids (aa) that spans the membrane seven 
times (GPCR), with the N terminus being extracellular and the C terminus 
intracellular [10-13], The receptor couples preferentially to Gi/Go to inhibit 
adenylate cyclase activity [14, 15], although coupling to the IP3/PKC/calcium 
mobilization pathway have also been described in recombinant systems [16], 
The 5-HT 1A receptor has also been found to stimulate cAMP accumulation via 
G i2 and ACII [17], as also shown in hippocampus [18], No splice variants are 
known and the gene is intronless. Two polymorphisms, Gly 22 —>Ser and lie 28 —► 
Val, have been found to alter the extracellular amino terminal region of the re¬ 
ceptor [19], The polymorphism Arg 219 —>Leu has been associated with Tourette's 
syndrome [20], The human polymorphism Ala 50 —>Val, occurring in transmem¬ 
brane 1, results in a loss of response to 5-HT [21], 


5-HT 1B receptors 

The 5-HT 1B receptor and its close homologue, the 5-HT 1D receptor, have ex¬ 
perienced a complex and debated history. The 5-HT 1B receptor was originally 
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defined according to operational criteria and thought to be a rodent-specific 
receptor, whereas 5-HT 1D was limited to non-rodent. However, similarities in 
transductional features, function, and brain distribution led to the opinion 
that the rodent “5-HT 1B ” and non-rodent “5-HT 1D ” receptors were species ho- 
mologues [22]; this was indeed confirmed when the receptors were cloned a 
few years later [23-30], To complicate matters, the pharmacologically defined 
human 5-HT 1D receptor was in fact a composite of two subtypes, encoded by 
distinct genes, which were called 5-HT 1Da and 5-HT 1Dp [28, 31]. This notation 
reflected the fact that the operational profiles of these two receptors, utilizing 
the ligands available at that time, were almost indistinguishable. It was subse¬ 
quently shown, in spite of overt differences in their pharmacological profiles, 
that 5-HT 1B and 5-HT 1Dp receptors are, respectively, rodent and non-rodent spe¬ 
cies homologues with 97% overall sequence homology. 

Interestingly, the differences in the pharmacology of these two homologues 
are largely attributed to the mutation of a single aa in the transmembrane span¬ 
ning region Asp 123 to Arg 123 [32], Eventually, the identification of the 5-HT 1M 
gene in rats confirmed that 5-HT 1B(1D receptors represent two different classes, 
prompting the need to revise the receptor notation according to the classifica¬ 
tion principles. Thus, the 5-HT 1Dp receptor is now known as 5-HT 1B ; consistent 
with the fact that it is the human homologue of the original rodent 5-HT 1B 
receptor. The human 5-HT 1B receptor is located on chromosome 6ql3, it is a 
GPCR negatively coupled to cAMP production but may also stimulate calcium 
release [33-36], However, it is important to remember that, because the human 
receptor assumes pre-eminence, the operational characteristics of the 5-HT 1B 
class are those defined for the human receptor. The 5-HT 1B receptor consists of 
a single polypeptide GPCR of 386-390 aa. There are no reported splice vari¬ 
ants. All known anti-migraine drugs of the sumatriptan series (triptans) act 
via the 5-HT 1B receptor [37-40]. SNPs in position 861 have linked the 5-HT 1B 
receptor with various disorders, such as alcoholism, substance abuse, attention- 
deficit hyperactivity disorder, aggression and depression [41-45], 


5-HT 1D receptors 

The 5-HT 1D receptor is located on chromosome Ip34.3-p36.3 and possesses 
63% overall structural homology with the 5-HT 1B receptor. It has 374-377 aa 
and is negatively coupled to cAMP production [24, 28, 31, 46], Its expression 
levels are very low compared with 5-HT 1B receptors, and it has been difficult to 
assign a functional role [47-50], The characteristics of the 5-HT 1B and 5-HT 1D 
subtypes are now well established, and the availability of new 5-HT 1B/1D -selec- 
tive ligands, SB 216641 (h5-HT 1B ) and BRL 15572 (h5-HT 1D ), enabled the lo¬ 
calization of a 5-HT 1D autoreceptor to the dorsal raphe nuclei [51-53], 5-HT 1D 
receptors in human heart may modulate 5-HT release. The currently available 
anti-migraine drugs do not distinguish between 5-HT 1B and 5-HT 1D receptors. 
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However, the selective 5-HT 1D receptor agonist, PNU 109291, has been shown 
to play a significant role in the suppression of meningeal neurogenic inflamma¬ 
tion and trigeminal nociception in guinea pig, suggesting 5-HT 1D receptor to be 
involved in migraine headaches, but such drugs are devoid of vascular activity 
confirming that it is the 5-HT 1B receptor that mediates the vasoconstrictor effects 
produced by sumatriptan and other triptans. Immunoreactivity for both the 
5-HT 1B and 5-HT 1D receptors is found in human trigeminal ganglia, where the 
receptors colocalize with calcitonin gene-related peptide, substance P and nitric 
oxide synthase. The 5-HT m receptor consists of a single polypeptide chain of 
374-377 aa that spans the membrane seven times, with the N terminus being 
extracellular and the C terminus intracellular. No splice variants have been re¬ 
ported. Polymorphism of the 5-HT 1D receptor have been linked to anorexia 
nervosa [54], 

5-HT 1B and 5-HT 1D receptors have been described to be modulated by 5-HT 
moduline (a tetrapeptide, LSAL, [55]). 5-HT 1B and 5-HT 1D receptors may form 
homo- or heterodimers [56, 57], 


5-ht 1E receptors 

The putative 5-ht 1E receptor was identified in radioligand binding studies in hu¬ 
man frontal cortex [58], but its wider distribution is still to be reported because of 
the absence of adequate tools. It is a 365-aa protein, negatively linked to adeny¬ 
late cyclase in recombinant cell systems [59-62], although positive modulation 
can be observed as well [63], It is present on human chromosome 6ql4-ql5 
[64], 5-ht 1E receptor mRNA and recognition sites exhibiting the pharmacological 
characteristics of the receptor have been mapped in monkey and human brain 
[47], A thorough characterization of the 5-ht 1E receptor awaits the development 
of selective ligands. Because confirmation of a true physiological role for 5-ht 1E 
receptors is still lacking, they retain their lower case appellation. No splice vari¬ 
ants are known. The receptor is apparently not expressed in rats or mice, since the 
mRNA codes for a stop codon [9, 61]. 


5-HT 1F receptors 

The 5-HT 1F receptor gene was originally detected in the mouse on the basis of 
its sequence homology with the 5-HT 1B / ID receptor subtypes; the human gene 
followed shortly afterwards [65-67], Initially, the receptor was designated 5- 
HT IEp . This was based on findings that the cloned 5-HT 1F receptor had a phar¬ 
macological profile close to that of the 5-ht 1E receptor (including low affinity 
for 5-CT), but that 5-HT IF receptor mRNA showed quite a different distribu¬ 
tion in the brain compared to 5-ht 1E receptor mRNA [47], 
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The 5-HT ir receptor is located on chromosome 3pll and has 366 aa. It is 
negatively linked to adenylate cyclase in recombinant cell systems [68], and most 
closely related to the 5-ht 1E receptor with >70% sequence homology (see also [5, 
69]). Little is known about the distribution and function of the 5-HT 1F receptor; 
mRNA for the human receptor protein has been identified in the brain (dorsal 
raphe, hippocampus, cortex, striatum, thalamus, and hypothalamus), in the 
mesentery, and in the uterus. The anti-migraine 5-HT 1B , 1D agonist sumatriptan, 
labels 5-HT 1F sites with high affinity [48], The binding site distribution was very 
similar to that for 5-HT 1F mRNA. Naratriptan also has affinity for 5-HT 1F recep¬ 
tors and it has been hypothesized that they might be a target for anti-migraine 
drugs. 5-HT 1F receptor mRNA has been detected in the trigeminal ganglia, 
stimulation of which leads to plasma extravasation in the dura, a component 
of neurogenic inflammation thought to be a possible cause of migraine [70, 71], 
but devoid of vasomotor effects [72], LY 334370, a selective 5-HT 1F receptor 
agonist, inhibits trigeminal stimulation-induced early activated gene expression 
in nociceptive neurons in the rat brainstem [70, 73], LY 334370, as a radioli¬ 
gand, shows prominent binding in the cortical areas, striatum, hippocampus 
and olfactory bulb compatible with 5-HT 1F mRNA distribution [74], 


5-HT 2 receptors 

There are currently three 5-HT 2 receptors: 5-HT 2A , 5-HT 2B and 5-HT 2C . 5-HT 2A , 
5-HT 2B and 5-HT 2C receptors exhibit 46-50% overall sequence identity and cou¬ 
ple preferentially to G q/11 to increase inositol phosphates and cytosolic [Ca 2+ ], 
The 5-HT 2A receptor refers to the classical D receptor initially described by 
Gaddum and Picarelli [1], and later defined as the 5-HT 2 receptor by Peroutka 
and Snyder [2], 5-HT 2B receptors were characterized almost 30 years ago to me¬ 
diate the contractile action of 5-HT in the rat fundus, and when cloned were 
initially named 5-HT 2F . In human pulmonary artery endothelial cells, 5-HT 2B 
receptor stimulation causes intracellular Ca 2+ release. The third 5-HT 2 receptor 
subtype corresponds to the previously known 5-HT lc receptor, as mentioned 
previously, and was initially identified in the choroid plexus. 


5-HT 2A receptors 

The 5-HT 2A receptor is located on human chromosome 13ql4-q21, and has 
471 aa in rat, mouse, and humans [15, 75-81], The gene, actually the whole 
5-HT 2 family, has a complex genomic organization; the first receptor of the 
family to be cloned was actually the 5-HT 2C receptor, and based on suggested 
homologies in the 5-HT 2 family [82], it did not take long to identify the 5-HT 2A 
receptor by homology screens [75, 76], It is widely distributed in peripheral and 
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central tissues and corresponds to the former 5-HT 2 or D receptor. 5-HT 2A re¬ 
ceptors mediate contractile responses in many vascular smooth muscle prepa¬ 
rations, e.g., bronchial, uterine and urinary smooth muscle, and part of the 
contractile effects of 5-HT in the guinea pig ileum. In addition, platelet aggre¬ 
gation and increased capillary permeability after exposure to 5-HT have been 
attributed to 5-HT 2A receptor-mediated functions. 5-HT 2A like the other 5-HT 2 
receptors, couple preferentially via G q/11 to the IP3/PKC/calcium pathway, al¬ 
though inhibition of cAMP production has been noticed. Non-functional 
splice variants have been reported, polymorphism in the promoter region has 
been associated with responses to clozapine in schizophrenics [83]. 


5-HT 2B receptors 

The 5-HT 2B receptor mediates fundic smooth muscle contraction. It was dif¬ 
ficult to characterize pharmacologically, due to operational features similar to 
those of other members of the 5-HT 2 family [76, 84] and very high affinity to 
5-HT, which suggested to some that it may belong to the 5-HT, “like” family. 
Eventually, the cloning of the rat, mouse and human “fundic” receptors (also 
reported as 5-HT 2F ) clarified the issue [79, 85-92], It is located on human chro¬ 
mosome 2q36.3-2q37.1. The receptor has 479-504 aa and no splice variants are 
known. 5-HT 2B receptor mRNA is found in rat fundus, gut, heart, kidney, lung 
and brain. Centrally, 5-HT 2B receptor-like immunoreactivity is restricted to cere¬ 
bellum, lateral septum, hypothalamus and medial amygdala [93], Application 
of BW 723C86 into the medial amygdala produces anxiolytic effects in rats 
[94], and 5-HT 2B receptor activation has been implicated in mediating hyper- 
phagia. 5-HT 2B , but not 5-HT 2C , receptor mRNA is found in a number of blood 
vessels. 5-HT 2B receptors on endothelial cells of pig pulmonary arteries and in 
rat jugular vein mediate vasorelaxation via NO release [95], 5-HT 2B receptors 
contract longitudinal muscle in human small intestine and when expressed in 
mouse fibroblast cells, cause mitogenesis linked to tumor transforming activity 
via MAP kinase. Activation of the 5-HT 2B receptor is most probably respon¬ 
sible for the valvulopathies reported for appetite suppressant preparations con¬ 
taining dex-fenfluramine [96], and receptor overexpression leads to ventricular 
hypertrophy by a mitochondrial mechanism [97], 


5-HT 2C receptors 

The 5-HT 2C receptor was one of the first 5-HT receptors to be cloned; however, 
full-length sequences were difficult to obtain, due to a highly complex exon-in- 
tron structure [79, 98-100], The receptor was mapped to human chromosome 
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Xq24 and has 458-460 aa. Given its similar pharmacological and transduc- 
tional features with the 5-HT 2A receptor, it did not take long to establish the 
sequence of the latter, based on homology cloning [75], Its distribution seems 
limited to the CNS and choroid plexus, the latter being where this receptor was 
originally identified [82, 101]. Although it has been demonstrated that 5-HT 2C re¬ 
ceptors in the choroid plexus couple to PLC activity [102, 103], additional func¬ 
tional correlates remain to be established [74], The 5-HT 2C receptor is one of the 
very few GPCRs mRNA undergoing editing [104-106], Thus, at least 14 func¬ 
tional isoforms (and potentially many more) of the 5-HT 2C receptor have been 
identified resulting from adenine deaminase editing of its mRNA. The 5-HT 2C 
receptor consists of a single polypeptide chain of 458^160 aa. There are also a 
few (non-functional) splice variants [107] in addition to the multiple RNA edit¬ 
ing variants. The different editing variants are characterized by varying degrees 
of affinity and intrinsic activity of 5-HT and other agonists, as well as constitu¬ 
tive activity and altered coupling to G proteins [106, 108-112], 

A potential link between a 5-HT 2C receptor allele and vulnerability to affec¬ 
tive disorders has been reported [113], and number of antipsychotics have in¬ 
verse agonist activity at 5-HT 2C receptors [108, 112]; however, similar observa¬ 
tions can be made for 5-HT 2A , 5-HT 6 and 5-HT 7 receptor. A -759T allele within 
the promoter region of the 5-HT 2C gene has a higher transcriptional activity 
than the more common -759C allele, which may lead to higher basal expression 
of 5-HT 2C receptors and subsequent protection against antipsychotic-induced 
weight gain [114], 


5-HT 3 receptors 

5-HT 3 receptors (M receptors of Gaddum and Picarelli, [1]) belong to the li¬ 
gand-gated ion channel receptor superfamily, and are similar to the nicotinic 
acetylcholine or GABA-A receptors and share electrophysiological and struc¬ 
tural patterns [115]. The receptors are found on central and peripheral neurons, 
where they trigger rapid depolarization due to the opening of non-selective cat¬ 
ion channels (Na + , Ca 2+ influx, K + efflux) [4, 5, 116], The response desensitizes 
and resensitizes rapidly. The native 5-HT 3 receptor, as revealed by electron mi¬ 
croscopy in neuroblastoma-glioma cells, is a pentamer [117]. 

At the molecular level, the 5-HT 3 receptor is a ligand-gated ion channel that 
is likely to be comprised of multiple subunits in common with other members 
of this superfamily. However, to date, only two genes have been recognized that 
encode 5-HT 3 receptors subunits (5-HT 3A receptor subunit) [118] comprised of 
487 aa, which display highest levels of identity with other members of the Cys- 
Cys loop ligand-gated ion channel superfamily (e.g. nicotinic, GABA a , and 
glycine receptors). A second subunit was isolated from various species, 5-HT 3B , 
which codes for 441 aa in humans [119]. 
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5-HT 3A and 5-HT 3B receptors 

A cDNA encoding a single subunit of the 5-HT 3A receptor was isolated from a 
neuronally derived cell line [118]. The human homologue maps to chromosome 
1 Iq23.1-q23.2. Two splice variants were reported in neuroblastoma-glioma cells 
(NCB-20, NG 108-15) and rat native tissue, with a similar distribution, phar¬ 
macological profile and electrophysiological characteristics when expressed as 
homomers. 5-HT 3 receptors are present in the CA1 pyramidal cell layer in the 
hippocampus, the dorsal motor nucleus of the solitary tract and the area pos- 
trema. In the periphery, they are located on pre- and postganglionic autonomic 
neurons and on neurons of the sensory nervous system [69, 119, 120], 5-HT 3 
receptor activation has pronounced effects on the cardiovascular system and 
regulates both motility and intestinal secretion throughout the entire GI tract. 
Species differences provide the basis of the pharmacological heterogeneity 
reported thus far. Nevertheless, extensive investigation has revealed a second 
subunit, 5-HT 3B , which has been cloned. The heteromeric combination of 5- 
HT 3A and 5-HT 3B subunits apparently provides the full functional features of 
the native 5-HT 3 receptor [119, 121, 122]: the 5-HT 3A subunit alone (in most 
cases) results in receptors with very low conductance and response amplitude 
[123-125], whereas so far, 5-HT 3B homomers have no activity [126], However, 
it is not established that 5-HT 3A and 5-HT 3B are systematically co-expressed or 
always form heteropentamers in situ [127-135], 

The patent literature has recently reported the cloning of additional potential 
subunits, 5-ht 3Cj 3I) 3E , but no additional information pertaining to their specific 
features are presently available [136, 137], The 5-HT 3 receptor, like other mem¬ 
bers of the ligand-gated ion channel receptor superfamily, possesses additional 
pharmacologically distinct, recognition sites, subject to allosteric modulation. 


Other 5-HT receptors 

5-HT 4 , 5-HT 6 and 5-HT 7 receptors all couple preferentially to G s and promote 
cAMP formation, yet they are classified as distinct receptor classes because of 
their limited (<35%) overall sequence identities, which are much lower as those 
featured by either 5-HT, or 5-HT 2 receptors. This subdivision is arbitrary and 
may be subject to future modification. 5-ht s receptors are a class apart, as nei¬ 
ther coupling nor function are clearly defined. 


5-HT 4 receptors 

The 5-HT 4 receptor was pharmacologically extensively characterized in cul¬ 
tured mouse colliculi neurons and guinea pig brain by Bockaert and co-work- 
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ers [138, 139] using stimulation of adenylate cyclase activity with the help of a 
number of benzamides. Similar functional responses mediated via the 5-HT 4 re¬ 
ceptor were reported in the GI tract [140], but also in the heart [141], It should 
be noted, however, that the ability of 5-HT to stimulate adenylate cyclase in 
the brain had been appreciated for a number of years previous to the pharma¬ 
cological definition of the 5-HT 4 receptor; e.g. Fillion and colleagues [141a] 
had reported 5-HT stimulated cAMP production in the brain in the late 1970s, 
although the relatively high concentration of methysergide (and some other 
compounds inactive at 5-HT 4 receptors) needed to antagonize these responses 
casts doubt over the involvement of 5-HT 4 receptors, suggesting a possible in¬ 
volvement of 5-HT 6 /5-HT 7 receptors. 

Thus, the 5-HT 4 receptor had been well described in both central and peri¬ 
pheral tissues long before cloning. Confusion between 5-HT M , 5-HT 3 and 
5-HT 4 receptors occurred at times [115], especially in tissues expressing multiple 
receptors such as the guinea pig ileum. Their existence was reported in rat neo¬ 
natal colliculi over 30 years ago. Cardiovascular receptors were also described 
as atypical or 5-HT 4 in the late 1980s. Interestingly, the potent 5-HT 3 recep¬ 
tor antagonist tropisetron (ICS 205-930) was described as the first competitive 
5-HT 4 receptor antagonist and this in combination with the use of benzamides 
opened the 5-HT 4 field in terms of pharmacology. 

The 5-HT 4 receptor was cloned as a GPCR [142, 143], and mapped to chro¬ 
mosome 5q31-33, initially with two splice variants. However, the 5-HT 4 recep¬ 
tor gene is very complex: it has a multitude of exons and possible splices vari¬ 
ants, in man and rodents [144], At least nine 5-HT 4 receptor splice variants have 
been identified (5-HT 4a -5-HT 4n ). The h5-HT 4d receptor isoform has not yet been 
described in other species, and is limited to the gut, whereas the other isoforms 
are more widely expressed. 

So far, all 5-HT 4 receptor variants couple positively to adenylate cyclase and 
have almost overlapping pharmacological profiles (e.g. [145]). One important 
feature of the receptor is the level of constitutive activity, manifest at rather low 
receptor levels, which may well explain differences observed with respect to vari¬ 
able intrinsic activity of a number of ligands, depending on tissue and/or species. 
The pattern of expression of the human 5-HT 4 receptor isoforms is tissue spe¬ 
cific. In addition to adenylate cyclase stimulation, direct coupling to potassium 
channels and voltage-sensitive calcium channel have been proposed. 

5-HT 4 receptors are coded by a very complex gene (700 kb, 38 exons), which 
generates a number of C-terminal variants. Gerald and colleagues [142, 143] 
were the first to isolate a cDNA of the 5-HT 4 receptor. Two isoforms were 
characterized, identical between residues 1 and 359 and differing only in the 
C terminus, generated by alternative splicing: named 5-HT 4L and 5-HT 4s for 
the long and short isoforms, respectively. Subsequently, a third shorter isoform 
was reported [146] and the nomenclature for these receptors became r5-HT 4(b) , 
r5-HT 4(a) , and r5-HT 4(e) . A similar diversity of isoforms was found for mouse, 
with four isoforms: 5-HT 4(a) , 5-HT 4(b) , 5-HT 4(e) , and 5-HT 4(t) [146, 147], In 1997, 
reports by Blondel, then Clayesen and Van den Wyngaert described the first 


168 


Jason Hannon and Daniel Hoyer 


human 5-HT 4 receptor isoform [147-149], Blondel et al. [150] isolated the re¬ 
ceptor from human atrium and named it h5-HT 4(a) being homologous to the 
short isoform described in rat. Several other splice variants were then cloned: 
h5-HT 4(b) , two different h5-HT 4(c) isoforms, h5-HT 4(d)j h5-HT 4(e) [150-152] (this 
isoform was later renamed h5-HT 4(g) ) [153, 154] and replaced by another h5- 
HT 4(e) isoform found to be more homologous to the mouse 5-HT 4(e) receptor 
[155], h5-HT 4(f) , [153] and h5-HT 4(n) [156], Whatever the species (mouse, rat or 
human), these splice variants (except 5-HT hb ) differ at their C termini after a 
single position (L358), whereas the length and the composition of the rest of 
the C-terminal tail is specific for each variant. Thus, in human, the C-terminal 
end is very short for the 5-HT 4(d) and 5-HT 4(n) isoforms (respectively, only 2 
and 1 aa after Leu 358) and the 5-HT 4(d) isoform (only 2 after Leu 358) and is 
31 aa long for the 5-HT 4(b) variant. Another variant h5-HT 4(bb) is characterized 
by a 14-residue insertion within the extracellular loop 2; 5-HT 4(i) was cloned 
from atrium [157], Like 5-HT 4(hb) with insert of exon h in the 5-HT 4(b) mRNA 
[153], the 5-HT 4(i) receptor mRNA has an additional exon (exoni) spliced in 
the 5-HT 4(b) mRNA between the common sequence and exon b, starting at base 
76574. The 5-HT 4(i) receptor mRNA contains an open reading frame of 1287 bp 
encoding a protein of 428 aa. Even though the complete b-tail is present, this 
splice was named 5-HT 4(i) , instead of, e.g., 5-HT 4(ib) , since the exon i is inserted 
in the C-terminal tail and to avoid several confusing double labels. The 5-HT 4(c) 
isoform might be the target of protein kinases because several phosphorylation 
sites are present on its C-terminal tail. The tissue distribution revealed some 
degree of specificity. For instance, 5-HT 4(a) , 5-HT 4(b) , 5-HT 4(c) , and 5-HT 4(g) re¬ 
ceptors are all expressed in the atrium, brain, and intestine. The 5-HT 4(a) and 
5-HT 4(b) receptor subtypes are the only receptors present in the bladder and 
kidney, respectively [150], The 5-HT 4(d) isoform is apparently only present in the 
intestine. The different isoforms expressed in various cells displayed the clas¬ 
sical profile of the 5-HT 4 receptors previously observed in the native tissues 
and show an identical ability to stimulate adenylyl cyclase activity. No major 
difference could be found between the different isoforms as far as the K. values 
of the agonists or the antagonist were considered. On the other hand, some 
significant differences in the functionality were observed with the agonists ML 
10302 and renzapride. ML 10302, described as a potent agonist in the GI tract 
in rat, was a weak partial agonist of each human isoform, whereas renzapride 
was a full agonist on the 5-HT 4(b) and 5-HT 4(d) isoforms and a partial agonist 
on the 5-HT 4(a) and 5-HT 4(g) receptors [151, 152], These functional differences 
may explain the tissue-dependent specificities observed with benzamides, which 
act as full or superagonists [139] in the mouse colliculus and as partial agonists 
[158-160] in other systems such as human myocytes. However, our own work 
carried out with a variety of splice variants (human) and drugs has so far failed 
to identify significant differences either in the pharmacological profile or the 
rank order of relative efficacy with a rather extensive range of ligands, thus the 
differences in apparent efficacy reported for various drugs along the GI tract 
still remains to be explained. 
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Two subtypes of the 5-ht s receptor (5-ht SA and 5-ht SB ), sharing 70% overall se¬ 
quence identity, have been cloned in rodents. The 5-ht 5A receptor has 357 aa 
across species and is located on human chromosome 7q36.1 [161-164], Hu¬ 
man recombinant 5-ht SA receptors inhibit forskolin-stimulated cAMP produc¬ 
tion, although the receptor may also couple positively to cAMP, inositol phos¬ 
phate production and to GiRK channels. Currently, a physiological readout 
for this receptor is still missing. The 5-ht SB receptor gene has been mapped to 
human chromosome 2ql l-ql3; however, it has been shown that the gene failed 
to encode a functional protein, due to the presence of stop codons in its cod¬ 
ing sequence [162, 164], There have been no published reports concerning a 
physiological functional response, and specific binding to a 5-ht s recognition 
site has not been described. It was also noticed that receptor levels might be in¬ 
creased in reactive gliosis. A putative role for 5-ht SA receptors in the acquisition 
of adapted behavior under stressful situations has been postulated and indeed 
A-843277, a selective 5-ht SA antagonist is reported to have anti-depressant/anti- 
psychotic properties in rodent models. 


5-HT 6 receptors 

The rat, mouse and human 5-HT 6 receptor has 436-440 aa and is positively 
coupled to adenylyl cyclase via G s . The human gene has 89% sequence homol¬ 
ogy with its rat equivalent, and maps chromosome region Ip35-p36 [165], Rat 
and human 5-HT 6 receptor mRNA is located in the striatum, amygdala, nu¬ 
cleus accumbens, hippocampus, cortex and olfactory tubercle, but has not been 
found in peripheral organs. Circumstantial evidence suggests the 5-HT 6 recep¬ 
tor to be expressed endogenously in neuronal tissue. A truncated, nonfunctional 
5-HT 6 receptor with a 289-bp deletion of the region coding for transmembrane 
IV and third intracellular loop has been identified in the caudate and substan¬ 
tia nigra of the human brain. 

The 5-HT 6 receptor promotes accumulation of cAMR NCB 20 and N18TG2 
cells and rat striatal neuronal cultures express a receptor that couples positively 
to adenylyl cyclase and displays an operational profile consistent with the recom¬ 
binant 5-HT 6 receptor [166], Similar evidence for the putative 5-HT 6 receptor 
has been obtained in homogenates of pig caudate nucleus: cAMP accumula¬ 
tion had a 5-HT 6 receptor profile and was antagonized by clozapine and me- 
thiothepin. [ 3 H]Clozapine binds with nanomolar affinity to two distinct sites in 
rat brain; one site displays the operational 5-HT 6 receptor profile. Coupling to 
calcium can also be seen in recombinant systems. 

The 5-HT 6 receptor can be labeled with [ 125 I]SB 258585 [167], Intracerebro- 
ventricular injections of 5-HT 6 receptor antisense oligonucleotides gave rise to 
a specific behavioral syndrome of yawning, stretching and chewing and caused 
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a 30% reduction in the number of [ 3 H]LSD binding sites (measured in the pres¬ 
ence of 300 nM spiperone). The antisense-induced behavioral syndrome can 
be dose-dependently antagonized by atropine, implying a modulatory role for 
5-HT 6 receptors on cholinergic neurons. The selective 5-HT 6 receptor antago¬ 
nist, Ro 04-6790, produces a behavioral syndrome involving an increase in ace¬ 
tylcholine neurotransmission. Enhanced retention of spatial learning follow¬ 
ing both antisense oligonucleotides and Ro 04-6790 has been reported. A role 
for the 5-HT 6 receptor in the control of central cholinergic function, and thus 
a putative target for cognitive dysfunction such as Alzheimer’s disease is thus 
suggested. Antipsychotics (clozapine, olanzapine, fluperlapine and seroquel) 
and antidepressants (clomipramine, amitryptyline, doxepin and nortryptyline) 
are 5-HT 6 receptor antagonists, in addition to multiple other affinities. This 
attribute tempted speculation of an involvement of the 5-HT 6 receptor in psy¬ 
chiatric disorders. 


5-HT 7 receptors 

The 5-HT, receptor has been cloned from rat, mouse, guinea pig and human 
cDNA and is located on human chromosome 10q21-q24. Despite demonstrat¬ 
ing high interspecies homology (>90%; see [168]), the receptor shares a low 
homology with other members of the 5-HT receptor family (<50%). The hu¬ 
man receptor has 479 aa (but splice variants vary in the length of the C termi¬ 
nus) and modulates positively cAMP formation via G s [169-171], The receptor 
also activates the mitogen-activated protein kinase, ERK, in primary neuronal 
cultures [172], The cDNA encoding the receptor contains two introns; one lo¬ 
cated in the second intracellular loop [169, 173] and the second in the predicted 
intracellular C terminus [174], Alternate splicing of this latter intron has been 
reported to generate at least four 5-HT 7 receptor isoforms (5-HT 7a -5-HT 7d ), 
which differ in their C termini [175] and vary amongst species. However, these 
isoforms, to date, have not been shown to differ in their respective pharma¬ 
cology, signal transduction or tissue distribution [176-178], A human 5-HT 7(a) 
receptor polymorphism Thr 92 —»Lys exhibits reduced agonist binding affinities. 
Functional studies have confirmed that the 5-HT 7 receptor has an extensive 
vascular distribution, and is responsible for the prominent, persistent vasodila¬ 
tor response to 5-HT in anesthetized animals [179], Moreover, the receptors 
are expressed in non-vascular smooth muscle and the CNS. [ 3 H]SB 269970 can 
be used as a selective radioligand for 5-HT 7 receptors [180] and it is now clear 
that this receptor is the orphan receptor originally described as the “5-HT,- 
like” receptor mediating relaxation various vascular and non vascular smooth 
muscles [3, 5, 69, 116], and subsequently shown to mediate elevation of cAMP 
and relaxation in neonatal porcine vena cava. 
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The 5-HT receptor family is large and diverse; molecular biology has largely 
confirmed (and extended) the suspected diversity and stopped discussions 
about too much complexity or redundancy of 5-HT receptors. It still remains 
to be seen what 5-ht s (or 5-HT 1F ) receptors do in real life. A graphical represen¬ 
tation of the current classification of 5-HT receptors is given in Fig. 1. There 
are multiple links between 5-HT receptors and disease, as illustrated by a large 
list of drugs active at one or the other of these receptors, other drugs being 
active at several receptors at a time, as illustrated by various antipsychotics. 
The complexity of the system is probably even larger than suspected, as illus¬ 
trated by the great number of splices variants for some receptors (e.g., 5-HT 4 ) 
or even editing variants (e.g., 5-HT 2C ). Similarly, complexity is also contributed 
by GPCR interacting proteins (not described here), other modulating proteins 
such as 5-HT moduline [55], homo and/or heterodimerization [56] (which may 
explain some features of the still orphan receptors such as 5-HT 1P ), and there 
is room for more 5-HT 3 receptors, especially when considering what nature has 
done with nicotine, GABA or glutamate receptors. 
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Fig. 1 Graphical representation of the current classification of 5-hydroxytryptamine (5- 
HT) receptors. Receptor subtypes represented by shaded boxes and lower case designate 
receptors that have not been demonstrated to definitively function in native systems. 
3’-5’ cyclic adenosine monophosphate (cAMP); phospholipase C (PLC); negative (-ve); 
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Abstract 

A series of studies was conducted on the electrophysiological activity of brain serotonergic 
neurons in behaving cats. The studies explored a wide variety of behavioral and physiologi¬ 
cal conditions. In general, neuronal activity of both rostral (mesencephalic and pontine) 
and caudal (medullary) groups of serotonergic neurons was strongly related to spontane¬ 
ous changes in behavioral state (highest in active waking and lowest during REM sleep). 
Across a wide variety of behavioral and physiological conditions (including stressors), the 
activity of these neurons was relatively unperturbed. However, one condition, motor activ¬ 
ity, strongly affected neuronal activity. A general relationship exists between level of tonic 
motor activity and serotonergic neuronal activity across all groups of serotonergic neurons. 
Superimposed upon this in some neurons is an additional relationship in which a further, 
often dramatic, activation is seen in association with repetitive, central motor program-me¬ 
diated behaviors (e.g., feeding, licking, respiration, and locomotion). The exact nature of 
this relationship varies both with the serotonergic neuronal group (e.g., locomotor-related 
medullary neuronal activity versus grooming-related mesencephalic neuronal activity) and 
within a particular group (e.g., respiratory-related and feeding-related medullary neuronal 
activity). We hypothesize that the primary function of this increased serotonergic neuronal 
activity in association with tonic and repetitive motor activity is to facilitate behavioral 
output by coordinating autonomic and neuroendocrine function in association with the 
existing motor demand, and by concomitantly suppressing activity in most sensory infor¬ 
mation processing channels. 


Introduction 

For the past 30 years, the major goal of our laboratory’s research has been the 
elucidation of the behavioral/physiological role of the mammalian CNS sero¬ 
tonin (5-hydroxytryptamine; 5-HT) system. Does it have a specific role or roles, 
or is it a ubiquitous neurotransmitter, like GABA or glutamate, exerting effects 
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on virtually all brain processes, and thus serving no specifiable behavioral or 
physiological function? Our feeling was that much of the research on brain se¬ 
rotonin was like the fable of the blind men and the elephant. Many people who 
studied the action of serotonin in a particular region of the CNS or in relation 
to a specific behavior or physiological process concluded, correctly, that this is 
what serotonin’s role was. For us, this was insufficient; it did not take the next 
step. Could all of these individual bits of data be integrated to form a whole, 
animated “elephant”? In other words, was there an overarching theory of CNS 
serotonin function that could account, at least in part, for the vast body of data 
on this topic? 

The primary tool that we employed in our work was measuring the elec¬ 
trical activity of individual serotonergic neurons (“single-unit recordings”) in 
unanesthetized, freely behaving domestic cats ( F. catus). Our philosophy was to 
allow ourselves to be guided by the leads provided by observing the variations 
in neuronal activity that emerged under a diversity of behavioral and physio¬ 
logical conditions. 

We are deeply indebted to a number of pioneering scientists whose research 
inspired, guided, and made our own work feasible. First, the value of the sin¬ 
gle-unit approach was dramatically and elegantly shown by the work of two 
laboratories. In the late 1950s and early 1960s, Hubei and Wiesel delineated 
the operating characteristics and function of visual system neurons in cats and 
monkeys. At the same time, Evarts showed the value of adapting this approach 
to behaving animals to study the function of various structures within the mo¬ 
tor system of monkeys. Second, invertebrate neurophysiologists, led by Eric 
Kandel, showed the value of studying identifiable individual neurons in relation 
to various functional outputs. In our version of this, we studied “members” of 
identifiable groups of neurons (in vertebrates one cannot identify a “specific” 
serotonergic neuron). Third, in an extraordinary series of studies, in the late 
1960s and early 1970s, George Aghajanian demonstrated that one could iden¬ 
tify and reliably record the single-unit activity of brain serotonergic neurons 
in rats. Finally, the elegant research and brilliant theorizing of our friend and 
mentor, Michel Jouvet, regarding the role of serotonin in state control, was 
a direct inspiration and motivating force for our work. 

The serotonin system is primitive in a number of ways [1,2]. First, the ba¬ 
sic plan for the cell bodies of these neurons is conserved throughout the ver¬ 
tebrates. This implies that its function must, to some degree, be common in 
the physiology and behavior of fish, amphibians, and reptiles as well as mam¬ 
mals, including primates. Second, virtually all of the cell bodies of serotoner¬ 
gic neurons are found in the brain stem, on or near the midline. This implies 
a somewhat stronger involvement in basic processes, especially those associated 
with axial functions, such as controlling the trunk and proximal limb muscles. 
Finally, these neurons and their processes are among the first to develop with 
ontogeny. All of this suggests that the central serotonin system subserves basic 
or fundamental functions within the CNS. 

The midline clusters of brain serotonergic neurons can be divided into two 
major groups. The rostral or superior group, localized in the pons/mesencepha- 
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Ion, contains two primary nuclei that supply most of the serotonin to the fore¬ 
brain: the nucleus centralis superior (NCS) and dorsal raphe nucleus (DRN). 
The caudal or inferior group, localized in the medulla, contains three primary 
nuclei that supply most of the serotonin to the brain stem and spinal cord: the 
nucleus raphe magnus (NRM), nucleus raphe obscurus (NRO), and nucleus 
raphe pallidus (NRP). 

We have examined the single-unit activity of neurons in both of these groups. 
In many ways their activity is quite similar, but they also differ in some interest¬ 
ing ways that reflects their varied functional roles. 


Basic neuronal characteristics 

We record single-unit activity in behaving cats with chronically implanted flex¬ 
ible microwires attached to a mechanical microdrive. This allows us to record 
the activity of the same neuron over long periods of time (often days) and de¬ 
spite active, gross movements. Many presumed 5-HT neurons have a distinctive 
“neuronal signature” that makes them unique in the CNS and allows them to 
be confidently identified on-line as serotonergic. They discharge in a slow (typi¬ 
cally 1-6 Hz) and highly regular manner. 

This clock-like activity is the manifestation of an endogenous pacemaker. 
These neurons also possess an unusually long-duration action potential (2- 
3 ms). These neuronal characteristics appear to be somewhat universal since 
they: (1) are observed in in vitro preparations, under anesthesia, and in behav¬ 
ing animals; (2) are seen in the several species in which this has been examined; 
and (3) are found in the various brain stem groups of 5-HT neurons [1], 

Although the preponderance of serotonergic neurons manifest these charac¬ 
teristics, (“typical”), brain serotonergic neurons with other electrophysiologi- 
cal features (“atypical”) have also been identified (see chapter by Sakai in this 
volume, and papers by Beck and colleagues [3]; Sharp and colleagues [4]; and 
Urbain and colleagues [5]). Unfortunately, there has been little attempt to ex¬ 
amine the response of these “atypical” serotonergic neurons across varied be¬ 
havioral and physiological conditions, other than the sleep-wake-arousal cycle. 
Furthermore, studies of these neurons have been limited, almost exclusively, to 
the DRN. 


Neuronal activity across the sleep-wake arousal cycle 

Early studies, by our laboratory [6] and those of McGinty and Harper [7], 
led to a re-evaluation of the role of serotonin in sleep, as originally proposed 
in an elegant series of studies by Jouvet and his students in the 1960s [8], In 
the quiet waking state in the cat, the activity of DRN 5-HT neurons is slow 
(~3 spikes/s) and regular, characteristic of the unmodulated operation of an 
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endogenous pacemaker [6], During an aroused state or in response to sensory 
stimuli, neuronal activity can be increased 30-50% above the quiet waking 
level. The most dramatic changes in the activity of 5-HT neurons occur during 
sleep. As animals become drowsy and enter slow-wave sleep, neuronal activity 
slows to approximately 50% of the quiet waking level and loses its regularity. 
Finally, during REM sleep, the activity of most brain 5-HT neurons declines 
dramatically, in many cases falling to zero. This general pattern of activity 
across the sleep-wake-arousal cycle displayed by 5-HT neurons in the DRN is 
also seen in the other major groups of brain stem 5-HT neurons: NCS, NRM, 
NRO, and NRP (Fig. 1) [6], There are, however, some interesting differences. 
For example, NRO/NRP serotonergic neurons tend to have a higher sponta¬ 
neous discharge rate (~5-6 spikes/s during quiet waking) than DRN seroto¬ 
nergic neurons and their activity displays a shallow rate of decline in going 
from aroused waking to slow-wave sleep, but then also declines precipitously 
in REM sleep. 


Serotonin Neuronal Activity during Behavioral 
States of Consciousness 
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Fig. 1 Activity of a typical medullary 5-HT neuron across the sleep-wake-arousal cycle 
(AW, active waking; QW, quiet waking; SWS, slow-wave sleep; REM, REM sleep). Note 
the positive relationship between neuronal activity and the level of tonic motor activity/ 
muscle tone in the nuchal EMG. EEG, electroencephalogram; EOG, electrooculogram; 
EMG, electromyogram 
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Neuronal response to stressors 

In attempting to understand the role of brain 5-HT neurons in physiology and 
behavior, we reasoned that it would be important to examine their activity un¬ 
der extreme conditions representing a variety of categories. Also, a number of 
studies have strongly implicated 5-HT in the stress response. Thus, we exami¬ 
ned neuronal responses in cats exposed to a variety of strong environmental 
and physiological stimuli. Accordingly, while recording the activity of 5-HT 
neurons in the DRN, NCS, or NRM, cats were exposed to the following condi¬ 
tions: a heated environment or a pyrogen, drug-induced increases or decreases 
in blood pressure, insulin-induced hypoglycemia, phasic or tonic painful stim¬ 
uli, systemic injections of morphine, loud noise, physical restraint, or a natural 
enemy (dog). Despite the fact that all of these conditions evoked strong behav¬ 
ioral responses and/or physiological changes indicative of sympathetic activa¬ 
tion, none of them significantly activated 5-HT neuronal activity in the DRN, 
NCS, or NRM beyond the level typically seen during an undisturbed active 
waking state (studies of the response of caudal medullary 5-HT neurons - in 
NRO and NRP - to autonomic nervous system perturbations are described in 
greater detail in a later section). 

A few examples from this series of studies illustrate this point. The activ¬ 
ity of DRN 5-HT neurons was examined in response to both increased 
ambient temperature and pyrogen-induced fever, stimuli eliciting opposite 
thermoregulatory responses [9], Neuronal activity remained unaffected as 
ambient temperature was increased from 25°C to 43°C. Following prolonged 
heat exposure, cats displayed intense continuous panting, relaxation of pos¬ 
ture, and a progressive rise in body/brain temperature (range 0.5-2.0°C), yet 
no change in 5-HT neuronal activity occurred. In a parallel study, a synthetic 
pyrogen (muramyl dipeptide) was administered systemically resulting in in¬ 
creased body/brain temperature within 30 min and lasting for approximately 
6 h. The peak elevation of body temperature was typically 1.5-2.5°C, yet, once 
again, no change in neuronal activity was observed. Consistent with these elec- 
trophysiological results, we have employed in vivo brain microdialysis and found 
no change in extracellular levels of 5-HT in the anterior hypothalamus, a primary 
thermoregulatory center of the cat, following pyrogen administration [10]. 

A large and relatively consistent body of evidence implicates central 5-HT 
in analgesia, especially those 5-HT neurons localized in the NRM and project¬ 
ing to the dorsal horn. Accordingly, we examined the activity of NRM 5-HT 
neurons in behaving cats exposed to a variety of phasic or tonic painful stimuli. 
No change in neuronal activity was produced by these stimuli relative to the 
discharge rate during an undisturbed active waking baseline [11], There was 
also no change in 5-HT neuronal activity in response to the systemic adminis¬ 
tration of morphine, in a dose that produced analgesia. These results have been 
confirmed in studies reporting that identified serotonergic NRM neurons in the 
rat were not activated by painful stimuli eliciting the withdrawal reflex or by 
analgesic doses of morphine [12, 13]. 


190 


Barry L. Jacobs and Casimir A. Fornal 


Studies in our lab employing in vivo brain microdialysis measures of extra¬ 
cellular 5-HT release in rats also support this general conclusion. We found no 
increase, relative to an active waking baseline, in 5-HT levels in various fore¬ 
brain structures in rats exposed to: painful stimuli; forced swimming; or a natu¬ 
ral enemy (cat) [14], 

In summary, these data indicate that mild to relatively strong stressors, drawn 
from a number of different environmental and physiological categories, do not 
significantly perturb brain stem serotonergic neurons when compared to a non¬ 
stressful active waking state. It is important to emphasize that stressors do ac¬ 
tivate the serotonergic system, but that they do so no more than other non¬ 
stressful, activating conditions. One way of reconciling this with the vast array 
of behavioral and physiological processes with which 5-HT has been implicated 
is to invoke a concept that might be termed conjunctive activation. Thus, 5-HT 
released during feeding may exert a role in satiety only in the presence of in¬ 
creased release of cholecystokinin (CCK). Employing this line of reasoning, 
5-HT released in reaction to exposure to stressors would exert a different ef¬ 
fect than it does during feeding because it now interacts with corticosterone 
rather than CCK. In addition, this acknowledges that such interactions may 
occur only in specific brain areas (e.g., hypothalamus versus hippocampus). In 
an important demonstration, Stutzman and colleagues [15] found that the elec- 
trophysiological effect of 5-HT on amygdala neurons in rats was abolished in 
the absence of corticosterone. 


Neuronal activity in relation to autonomic function 

The relationship between the activity of medullary 5-HT neurons (NRO and 
NRP) and autonomic function, is of special interest because these neurons have 
extensive projections to the intermediolateral cell column of the thoracic spi¬ 
nal cord, where they make connections with many sympathetic pre-ganglionic 
neurons, including those that innervate the adrenal medulla [3], Reciprocally, 
5-HT medullary neurons receive direct synaptic inputs from the rostral ventro¬ 
lateral medulla [40], the primary source of sympathetic activity. A number of 
studies have shown that 5-HT exerts predominantly an excitatory influence on 
sympathetic outflow [16, 17]. Therefore, medullary 5-HT neurons may serve a 
homeostatic role in regulating arterial blood pressure and heart rate, body tem¬ 
perature, and blood glucose concentrations. 

In one series of experiments [18], we examined the activity of medullary 5- 
HT neurons during manipulations of the cardiovascular system. Transient al¬ 
terations in arterial blood pressure (and sympathetic activity) were produced 
by intravenous administration of vasoactive drugs. The activity of 5-HT NRO/ 
NRP neurons was not significantly altered in response to phenylephrine (a va¬ 
soconstrictor) or sodium nitroprusside (a vasodilator), at doses that elicited 
marked reflex bradycardia and tachycardia, respectively. Furthermore, no signif- 
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icant changes in neuronal activity were observed after systemic administration 
of hydralazine, a direct long-acting vasodilator, despite prolonged reflex acti¬ 
vation of the sympathetic nervous system, as indicated by sustained increases 
in heart rate and plasma norepinephrine levels. Acute venous hemorrhage, up 
to 22.5% of estimated total blood volume, also had no effect on the activity of 
NRO/NRP neurons, despite the fact that plasma catecholamine levels were sig¬ 
nificantly elevated by this manipulation. Overall, these results do not support a 
direct role of 5-HT NRO/NRP neurons in the reflex alterations in sympathetic 
(and parasympathetic) outflow evoked by these cardiovascular manipulations. 
This suggests that any involvement of 5-HT medullary neurons in cardiovascu¬ 
lar regulation is mediated independently of cardiovascular afferent activity. 

In a subsequent experiment [19], we examined the effects of cold exposure, 
a potent activator of the sympathetic nervous system. The discharge rate of 
approximately half of the NRO/NRP cells studied was significantly increased 
by about 30% during exposure to a low ambient temperature (4-8°C), which in¬ 
duced shivering and piloerection in animals, but no appreciable change in core 
temperature. The elevation in neuronal activity was maintained throughout the 
entire cooling period (2 or 4 h) and was unrelated to the occurrence of shiver¬ 
ing bursts per se, but there appeared to be a relationship to an overall increase 
in muscle tone. The activity of these cells returned to baseline levels within 15- 
BO min after the cats were transferred back to room temperature. These electro- 
physiological data are consistent with previous neurochemical studies showing 
that acute cold exposure markedly increases 5-HT synthesis, metabolism, and 
utilization in the thoracic spinal cord of rats, in association with sympatho- 
excitation [20], That the activation of medullary 5-HT neurons may play an 
important role in thermoregulatory responses is supported by studies which 
show that 5-HT-depleted animals are unable to defend against cold stress, as 
indicated by large decreases in body core temperature. Interestingly, none of 
the 5-HT neurons studied in the DRN, which have few, if any, projections to 
the thoracic spinal cord, were affected by cold exposure, indicating some degree 
of regional specificity to this manipulation. 

Overall, these results suggest a role for some NRO/NRP 5-HT neurons in 
the physiological mechanisms underlying cold defense (i.e., increased heat pro¬ 
duction/conservation). However, it is unclear whether the primary stimulus to 
these neurons was sympathetic or motor in nature. 

We have also used insulin-induced hypoglycemia to preferentially activate 
the sympathoadrenal system [21], Administration of insulin (2-4 IU/kg, i.v.) 
produced a 50% decrease in blood glucose and a near eightfold increase in 
plasma epinephrine levels. Surprisingly, the discharge rate of 5-HT NRO/NRP 
neurons was reduced by approximately 40% after insulin administration. The 
subsequent administration of glucose temporally reversed the effect of insu¬ 
lin on blood glucose, plasma epinephrine and neuronal activity. Thus, firing 
rate was directly correlated with blood glucose, and more importantly, inversely 
correlated with plasma epinephrine levels. Since medullary 5-HT neurons are 
thought to subserve a sympathoexcitatory role, these results contradict what 


192 


Barry L. Jacobs and Casimir A. Fornal 


would be predicted for these cells. However, animals treated with insulin also 
displayed diminished muscle tone and signs of muscle weakness, which closely 
paralleled the decreases in neuronal activity observed after insulin administra¬ 
tion. Thus, the effect of systemic insulin on 5-HT neuronal activity is, once 
again, more likely related to changes in motor output rather than to changes in 
sympathetic outflow. 

Overall, these results suggest that the discharge of medullary 5-HT neurons 
is not strongly related to sympathetic activity in the absence of concomitant 
changes in motor output. These neurons may indeed influence sympathetic ac¬ 
tivity, but do so only in relation to increases in motor output, as this appears to 
be the primary determinant of 5-HT neuronal activity in the behaving animal 
(see below). Thus, the function of these neurons may be to coordinate the activ¬ 
ity of both sympathetic and somatic motor systems in association with the level 
of motor output. 

Medullary 5-HT neurons may also participate in the central control of 
respiration through connections with respiratory-related structures in the 
pons/medulla and phrenic motor neurons (see chapter in this volume by 
Richerson). Recent electrophysiological studies have shown that rat medul¬ 
lary 5-HT neurons recorded in vitro are highly sensitive to changes in C0 2 
and/or pH, suggesting that they may function as “central chemoreceptors” 
to modulate respiratory output [22], To determine whether medullary 5-HT 
neurons are chemosensitive in vivo, we examined the responses of these neurons 
to hypercapnia [23], a potent respiratory stimulus that augments ventilatory 
output by activating primarily central, and to a lesser extent, peripheral che¬ 
moreceptors. In support of a role in respiratory modulation, a subset (22%) 
of NRO/NRP neurons was activated in association with increased respiration 
induced by inhalation of C0 2 (Fig. 2). The magnitude of the neuronal response 
was correlated positively with the fraction of inspired C0 2 and was related to 
ventilatory motor output, specifically inspiratory amplitude. The threshold 
level of C0 2 for producing a significant increase in firing rate was about 3%, 
suggesting relatively high chemosensitivity. During sleep, the responsiveness of 
these neurons to systemic C0 2 stimulation was greatly reduced or abolished, 
and paralleled the diminished ventilatory sensitivity to C0 2 . These data suggest 
that diminished activation of 5-HT neurons during sleep may contribute to the 
reduced motor responses to hypercapnia and, therefore, may play an important 
role in sleep-related breathing disorders, such as sleep apnea and sudden infant 
death syndrome (SIDS). Additionally, a small subset (25%) of 5-HT neurons 
in the DRN was also activated by hypercapnia [24], Some of these cells, which 
are known to project to the cervical spinal cord, may directly influence respira¬ 
tory motor output. Although these studies provide evidence that 5-HT neurons 
in both the rostral and caudal raphe nuclei are sensitive to hypercarbia under 
physiological conditions, it is not clear whether the neuronal responses were 
intrinsic or synaptically mediated by other cells involved in respiratory control, 
as this would require blockade of afferent inputs to address. Furthermore, 
although hypercapnia can induce profound effects on cerebral blood flow, car- 
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Serotonin Neuronal Activity Increases during 
Deep Breathing 
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Fig. 2 Activation of medullary 5-HT neurons during increased respiration induced by 
inhalation of C0 2 . The top left panel shows the concentration-response curve to C0 2 for 
a group of responsive cells. The asterisk denotes the threshold concentration of C0 2 for 
producing a significant increase in mean firing rate. The bottom panels show the activity 
of one of these cells, along with respiration, at baseline, when the cat was breathing 
room air, and then at 4% and 8% C0 2 . Note the progressive increase in respiratory depth 
and firing rate of this cell (adapted from [23]) 


diac output, and arterial pressure, 5-HT neurons in general are unresponsive 
to alterations in cardiovascular activity, as discussed above. Therefore, it is 
unlikely that the observed neuronal responses to increased C0 2 are mediated 
by secondary changes in cardiovascular function induced by hypercarbia. 
Consistent with our findings in awake animals that some 5-HT neurons are 
activated by hypercapnia, systemic C0 2 stimulation in cats has been reported to 
induce c-fos expression (a marker of neuronal activation) in the caudal raphe 
[25]; however, double-labeling experiments are needed to positively identify 
these cells as serotonergic. 

Finally, to the extent that we have examined this issue, the discharge pat¬ 
terns of 5-HT NRO/NRP neurons in the awake, freely moving animal do not 
appear to be phasically related to the respiratory cycle [23]. However, the tonic 
changes in firing rate observed across the sleep-wake cycle and in response to 
systemic C0 2 stimulation are likely to be important in the central control of 
respiration. 
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Neuronal activity and muscle tone/tonic motor activity 

Initial clues that there might be an important relationship between 5-HT neu¬ 
ronal activity and motor activity came from our early experiments where motor 
output was drastically altered. A fundamental feature of REM sleep is a pa¬ 
ralysis that derives from the powerful inhibition of motor neurons controlling 
antigravity muscle tone. Because the activity of 5-HT neurons is almost totally 
suppressed during REM sleep, we examined the possibility that there might be 
a relationship between these two phenomena. Electrolytic lesions of the dorso- 
medial pons produce a condition that permits investigation of this issue. Cats 
with this lesion enter a stage of sleep that by all criteria appear to be REM 
sleep except that antigravity muscle tone is present, and the animals are thus 
capable of movement and even coordinated locomotion. In both waking and 
slow-wave sleep, the activity of DRN serotonergic neurons in these pontine- 
lesioned cats was similar to that of normal animals [26], However, when these 
animals entered REM sleep, neuronal activity increased, instead of display¬ 
ing the decrease typical of this state (Fig. 3). Animals displaying the greatest 
amount of muscle tone and overt behavior during REM sleep showed the high¬ 
est levels of neuronal activity, with some of their 5-HT neurons discharging at 
a level approximating that of the waking state. 


Serotonin Neuronal Activity Increases during REM 
Sleep With Muscle Tone 


' 

. 

. • v r" 







J 4 



Fig. 3 Activity of a DRN 5-HT neuron in a pontine-lesioned cat displaying REM sleep 
without muscle atonia. When these animals entered REM sleep, neuronal activity incre¬ 
ased (rather than normally shutting off) in association with increased muscle tone and 
movement. See Fig. 1 for abbreviations (adapted from [26]) 
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Gross motor activity can also be manipulated in another way that could 
shed light on this issue. Microinjection of carbachol (4-16 mg), a cholinomi¬ 
metic agent, into this same pontine area where lesions were made in the pre¬ 
ceding experiment, produces a condition somewhat reciprocal to non-atonia 
REM sleep. The animals are awake, as demonstrated by their ability to track 
visual stimuli, but are otherwise paralyzed. However, unlike the normal waking 
state where 5-HT neurons are tonically active, DRN 5-HT neurons were inac¬ 
tive in these immobilized animals [27], In the same study, we also found that 
a centrally acting muscle relaxant drug completely suppressed 5-HT neuronal 
activity, but peripheral neuromuscular block had no effect on neuronal activity. 
This implies that it is not the movement per se that is critical to 5-HT neuronal 
activity, but some aspect of the message deriving from the central motor com¬ 
mand hierarchy. It also indicates that proprioceptive feedback does not exert 
an important influence on 5-HT neuronal activity, since peripherally induced 
paralysis had no effect on this activity. Recently, we conducted a similar small 
study on NRO/NRP neurons [28], When carbachol was injected into the dorso¬ 
lateral pons, it produced profound muscle inhibition, which was accompanied 
by almost complete suppression of NRO/NRP 5-HT neuronal activity (Fig. 4). 


Serotonin Neuronal Activity Decreases during 
Wakefulness Without Muscle Tone 
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Fig. 4 Activity of a medullary 5-HT neuron during carbachol-induced muscle atonia. 
Neuronal activity in these centrally paralyzed animals was essentially off, as in REM 
sleep, but the cats were clearly awake, as demonstrated by their ability to track visual 
stimuli. See Fig. 1 for abbreviations. iEMG, integrated electromyogram 
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These findings are consistent with the hypothesis that these neurons contribute 
to the maintenance of muscle tone during waking by facilitating motor neuron 
excitability, and that their inactivity plays a role in the loss of muscle tone dur¬ 
ing both REM sleep and carbachol-induced atonia. 

These data suggest that a strong positive relationship exists between tonic 
level of motor activity (muscle tone) and the firing rate of DRN 5-HT neurons. 
In more recent experiments, we have observed more specific relationships be¬ 
tween 5-HT neuronal activity and phasic motor function. 


Neuronal activity and phasic motor activity 

When cats engage in a variety of types of central pattern generator (CPG)- 
mediated oral-buccal activities, such as chewing/biting, licking, or grooming, 
approximately one-fourth of DRN 5-HT neurons increase their activity by as 
much as two- to fivefold (Fig. 5) [29], In contrast, the rest of the 5-HT neurons 
in this nucleus maintain their slow and rhythmic activity. These increases in 
neuronal activity often precede the initiation of movement by several seconds, 
but they invariably terminate precisely coincident with the end of the behav¬ 
ioral sequence. Equally impressive is the fact that even brief (1-5 s) spontane¬ 
ous pauses in these behaviors are accompanied by an immediate decrease in 
neuronal activity back to baseline levels, or below (see Fig. 5). During a variety 
of other non-rhythmic episodic or purposive movements, even those involv¬ 
ing oral-buccal responses, such as yawning, no increase, or even a decrease, in 
neuronal activity is seen. In addition, there is often an inverse relationship be¬ 
tween the activity of these 5-HT neurons and the occurrence of eye movements. 
This could, of course, be a relationship to another variable such as attentional 
changes, rather than to eye movements per se. In fact, during dramatic atten¬ 
tional shifts, such as those occurring during orienting movements in response 
to imperative stimuli, the activity of DRN 5-HT neurons may fall silent for sev¬ 
eral seconds [29], This occurs in association with large eye movements, turning 
the head toward the stimulus, and suppression of ongoing behaviors. 

Based on these data demonstrating a strong relationship between DRN 5- 
HT neurons (those that innervate forebrain) and motor activity, we explored 
these same issues for NRO and NRP neurons (those that innervate the spinal 
cord). In contrast to mesencephalic 5-HT neurons, where only a subgroup is 
activated during CPG-mediated behaviors, virtually all medullary serotoner¬ 
gic neurons are activated under at least some of these conditions [23], The de¬ 
gree of activation, however, is much less (i.e., 50-100% above baseline versus 
100-400% above baseline for the DRN). In this context, it may be important to 
note that the basal, quiet waking discharge rate of medullary serotonergic neu¬ 
rons is approximately twice that of mesencephalic serotonergic neurons (5-6 vs 
2-3 spikes/s). There also appears to be at least some degree of response speci¬ 
ficity for these neurons. Thus, virtually all medullary serotonergic neurons are 
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Serotonin Neuronal Activity Increases during 
Repetitive Oral Movements 
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Fig. 5 Activation of a DRN 5-HT neuron during spontaneous grooming behavior. The 
horizontal line beneath the unit trace denotes periods of oral-buccal grooming activity. 
Note the rhythmic muscle activity and eye movements associated with grooming, as well 
as the pauses in neuronal activation during pauses in grooming. See Fig. 1 for abbrevia¬ 
tions (adapted from [29]) 



activated during treadmill-induced locomotion (Fig. 6), but only subgroups are 
activated during increased respiratory output induced by hypercapnea, or dur¬ 
ing chewing/licking. Many of these individual neurons are activated in associa¬ 
tion with more than one of these motor activities. Initial indications are that, 
like the rostral 5-HT neurons, at least some of these caudal 5-HT neurons can 
be activated by somotosensory stimulation. It is still not clear whether there is a 
preferential body area, e.g., trunk or limbs versus head, where such stimulation 
is most effective. Finally, unlike DRN 5-HT neurons, NRO and NRP neuronal 
activity is not suppressed during eye movements or orienting responses. This 
may reflect a lack of involvement of the spinal cord-projecting neurons in cog¬ 
nitive functions such as attention. 

During treadmill-induced locomotion the magnitude of increased neuronal 
activity showed a strong positive correlation with the speed of running (from 
0.25 to 0.85 m/s) [23], In addition, the pattern of activation varied for different 
neurons. Some increased their activity only at higher speeds, others increased 
their activity at lower speeds and then showed no further increase, whereas 
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Serotonin Neuronal Activity Increases 
during Locomotion 
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Fig. 6 Activation of a medullary 5-HT neuron during treadmill locomotion. The cell in¬ 
creased its firing rate as soon as the cat began running on the treadmill (speed = 0.4 m/s). 
Neuronal activity returned immediately back to, or just below, baseline levels when the 
treadmill was stopped (adapted from [23]) 


others showed a linear increase in association with increasing treadmill speeds. 
A few cells even displayed an increased discharge that was in phase with the 
step cycle. Finally, the excitatory neuronal response during treadmill locomo¬ 
tion was precisely coincident with the onset of the treadmill and remained sta¬ 
ble for a given speed. When the treadmill was stopped, unit activity returned 
immediately to, or just below, baseline (see Fig. 6). This suggests that the firing 
rate of these neurons is tightly coupled to motor activation rather than auto¬ 
nomic activity, such as heart rate and blood pressure, which remain elevated 
after locomotor activity has stopped. 

During feeding two distinct patterns of neuronal activation were observed 
for NRO/NRP neurons [23], For most cells the increase occurred precisely at 
feeding onset and was maintained throughout the feeding period. Unit acti¬ 
vity abruptly returned to baseline levels with the cessation of eating. Thus, 
the activity of these neurons appears to be temporally correlated with diges¬ 
tive behaviors such as chewing, licking, or swallowing. In contrast, a few cells 
demonstrated gradual increases in unit activity during feeding, reaching a pla¬ 
teau 60-80 s after feeding onset, and then only gradually returned to baseline 
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minutes after the termination of feeding. The elevated activity of this subset 
of neurons is more temporally related to ongoing digestive processes, such as 
gastric secretion and motility. We hypothesize that these neurons play a role in 
gastrointestinal function via projections to the parasympathetic preganglionic 
neurons in the dorsal vagal complex. 

Increases in neuronal activity were also noted during spontaneously occur¬ 
ring movements such as struggling, neck extension, moving from a crouched 
position to standing, and limb movements (e.g., during stretching or digging 
movements). Although increases in neuronal activity were consistently ob¬ 
served with these spontaneous movements, passive movements of the head or 
limbs by the experimenter did not activate these cells. 

Finally, when DRN neurons were examined under identical conditions, 
none were activated during treadmill-induced locomotion or cold exposure, but 
some were activated during C0 2 -induced hyperpnea [24], 


Neuronal activity and fatigue 

Physical exercise cannot be maintained indefinitely and eventually fatigue will 
terminate motor output. Traditionally, peripheral factors, such as intramuscu¬ 
lar depletion of energy substrates (e.g., glycogen) or accumulation of metabolic 
byproducts (e.g., lactic acid), have been thought to be responsible for fatigue, 
although there is now clear evidence that changes within the CNS can con¬ 
tribute to fatigue [30], Besides its direct role in motor output, it is becoming 
increasingly clear that the debilitating fatigue associated with some chronic 
diseases (e.g., chronic fatigue syndrome and multiple sclerosis) also appears to 
be mainly of central origin [30, 31], and is also an important factor in depres¬ 
sion [31]. 

Central fatigue consists principally of a failure to maintain full motor unit 
recruitment and/or optimal motor unit discharge for muscle force production 
[32], and has been linked to an inadequate descending drive from the motor 
cortex [33], Serotonin is the neurotransmitter most often implicated in human 
forms of fatigue and in animal experiments examining exercise-induced fatigue 
[30, 34, 35], Recent work in our laboratory suggests that 5-HT neurons in the 
NRO and NRP may play an important role in various aspects of central fatigue 
[36], These neurons are known to facilitate both the excitability and the recruit¬ 
ment of a-motor neurons [37], As described above, in the awake cat, the activity 
of these 5-HT neurons is suppressed in relation to diminished motor capacity 
(i.e., experimentally induced muscle hypotonia/atonia, and muscle weakness). 
These findings have led us to hypothesize that diminished activity of the de¬ 
scending medullary 5-HT system may be an important component of central 
fatigue. During prolonged treadmill locomotion (0.4 m/s for 30-60 min), we 
have found that the activity of some NRO/NRP 5-HT neurons progressively 
decreases from baseline levels (Fig. 7) [36], An additional more rapid decline 
is often observed immediately after the treadmill is turned off, at the time the 
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Serotonin Neuronal Activity Decreases during 
the Development of Locomotor Fatigue 


Treadmill On 



Fig. 7 Activity of a medullary 5-HT neuron during prolonged treadmill locomotion to 
fatigue and subsequent recovery. Following an initial increase in firing rate, neuronal 
activity steadily declined throughout the locomotor trial, until the cat could no lon¬ 
ger keep pace with the treadmill (i.e., point of fatigue). When the treadmill was turned 
off, neuronal activity precipitously dropped to zero and then slowly began to recovery. 
Neuronal activity could be reactivated in the fatigued animal by briefly restarting the 
treadmill a few minutes later (adapted from [36]) 


cat can no longer keep pace, i.e., “fatigue”. Neuronal activity in these animals 
gradually returns to baseline within 30-60 min. During this recovery period, 
activity can be reactivated momentarily by turning on the treadmill, indicat¬ 
ing that increased motor output is still capable of driving these cells, albeit at 
a reduced rate. 

Preliminary evidence suggests that these effects of sustained locomotor ac¬ 
tivity may be unique to NRO/NRP 5-HT neurons, inasmuch as DRN-5-HT 
neurons do not appear to show this decline. We hypothesize that during pro¬ 
longed locomotor activity, a central mechanism is activated inhibiting the out¬ 
put of medullary 5-HT neurons, which in turn, leads to a disfacilitation of 
a-motor neuron excitability (and autonomic dysregulation), thus contributing 
to the development of fatigue. 

Some of the factors that might be responsible for this fatigue-related de¬ 
crease in 5-HT neuronal activity and, thereby, contribute to the development 
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of fatigue are: (1) whole body carbohydrate stores which become depleted dur¬ 
ing prolonged exercise (glucose administration to animals exhibiting signs of 
fatigue may reverse these effects); (2) a progressive increase in core body tem¬ 
perature, which is thought to limit physical output (cooling or antipyretic drugs 
may therefore reverse these alterations in 5-HT neuronal activity); and (3) hy¬ 
poxia may be important in the decreased 5-HT neuronal activity seen during 
fatigue. 


Discussion 

A general relationship exists between level of tonic motor activity and 5-HT 
neuronal activity across all groups of 5-HT neurons that we have studied. Su¬ 
perimposed upon this in some neurons is an additional relationship in which a 
further, often dramatic, activation is seen in association with repetitive, CPG- 
mediated behaviors. The exact nature of this relationship varies both with 5-HT 
grouping (e.g., locomotor-related NRP neuronal activity versus grooming-re¬ 
lated DRN neuronal activity) and within a particular group (e.g., respiratory- 
related and feeding-related NRP neuronal activity). The primary function of 
this increased 5-HT neuronal activity in association with tonic and repetitive 
motor output is to coordinate autonomic and neuroendocrine function in as¬ 
sociation with the existing motor demand, and to suppress activity in most sen¬ 
sory information processing channels [38, 39], 

There are several reasons for believing that the facilitation of motor out¬ 
put by 5-HT is general in nature. Firstly, 5-HT neuronal activity is generally 
tonically elevated during the execution of a particular behavior, suggesting that 
5-HT is facilitating the “behavior” rather than a particular motor act or muscle 
group that is a component of the behavior. Secondly, the distribution of 5-HT 
axon terminal innervation of the brain stem and spinal cord is consistent with 
the involvement of 5-HT in patterned movement employing gross skeletal mus¬ 
cles rather than movements using finer or more discrete muscles, such as those 
controlling the eyes or the digits. Thus, in the spinal cord there is a denser input 
to the medial portion of the ventral horn, where axial motor neurons serving 
the trunk and limbs are found, compared to the lateral portions, where distal 
motor neurons serving paws and digits are found [40], Thirdly, there is evidence 
that spinally projecting medullary 5-HT neurons collateralize at various levels 
of the cord, suggesting a broad relationship to motor activity [41], Finally, the 
fact that single medullary 5-HT neurons may project to both the intermedio- 
lateral column of the spinal cord as well as to the ventral horn suggests an 
integrative function involving motor and autonomic control [41], 

Several important functions may be served by these 5-HT inputs to motor 
structures. They may smooth motor outputs and may also obviate the need 
for continuous repetitive excitatory inputs to maintain a continuous output in 
motor systems. By augmenting weak or polysynaptic inputs, 5-HT may also 
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bring motor neurons to their firing threshold. The anticipation of motor activ¬ 
ity by 5-HT neurons suggests that they may serve a “priming”, and possibly 
a conditioning, function for motor output. (It is not yet clear if NRO/NRP 
5-HT neurons manifest this anticipatory response, as do DRN 5-HT neurons.) 
The simultaneous inhibition of irrelevant sensory information processing acts 
to suppress inputs that might disrupt motor output. Finally, 5-HT’s involve¬ 
ment in autonomic and neuroendocrine regulation serves a support function 
for the demands associated with changes in the level of motor output, such as 
increased oxygenation of the blood and redistribution of blood flow to skeletal 
muscles, or increased glycogenolysis for maintaining a stable glucose supply to 
the brain. 

One of the most impressive aspects of 5-HT’s involvement in motor control 
is its generality across phylogeny. There is evidence in a variety of invertebrate 
species that 5-HT may play a broad, and even integrative, role in such diverse 
functions as postural control, swimming, and feeding. As discussed above with 
regards to mammals, there is evidence that in invertebrates 5-HT exerts its ef¬ 
fects on behavior at multiple levels: on motor neurons, muscles, CPGs, cardio¬ 
vascular system, etc. [42, 43], 

In sum, we hypothesize that the primary role of the 5-HT system is to pro¬ 
vide coordination of motor, autonomic and sensory processes, which are ac¬ 
tivated with central motor commands. Furthermore, we believe that all other 
behavioral and physiological functions that have been associated with 5-HT in 
the brain and spinal cord are derivative of this fundamental relationship. 
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Abstract 

When their activity is recorded extracellularly in freely moving animals, all brainstem se¬ 
rotonergic neurons are characterized by a typical bi- or triphasic action potential of long 
duration, a slow discharge activity, a decrease in spontaneous discharge rate during para¬ 
doxical sleep (PS) compared to slow-wave sleep (SWS), a depressant response to seroto¬ 
nergic autoreceptor agonists, and a slow conduction velocity. These unit-recording studies 
further demonstrate a marked heterogeneity of brainstem serotonergic neurons in general 
and of serotonergic dorsal raphe (DRN) neurons in particular. Serotonergic DRN neu¬ 
rons can be subdivided into two “typical” (types I-A and I-B) and four “atypical” (types 
I-C, II-A, II-B, and II-C) populations, whereas serotonergic medullary neurons can be 
divided into “complete” and “incomplete” types on the basis of their firing pattern dur¬ 
ing PS. “Typical” DRN neurons are evenly distributed in the DRN, and their activity is 
related to the level of behavioral arousal, as they discharge regularly at a high rate during 
waking (W) and at progressively slower rates during SWS, and cease firing during SWS 
with ponto-geniculo-occipital waves and PS (type I-A) or only during PS (type I-B). Sero¬ 
tonergic neurons in the nucleus raphe centralis superior (NCS) appear to be very much like 
type I-A and I-B DRN neurons in their activity across the sleep-waking cycle. In contrast, 
“atypical” neurons are unevenly distributed in the DRN and exhibit firing patterns distinct 
from those of “typical neurons”, such as a high rate of tonic activity related to motor 
activity (type II-A), a highest rate of tonic discharge during SWS with suppression of dis¬ 
charge during both W and PS (type II-B), or a sustained high or low level of tonic activity 
during PS (type I-C or II-C, respectively). Type II-A neurons are located in the middle por¬ 
tion of the DRN, type II-B in the most rostral and dorsal portion of the DRN, and types 
I-C and II-C in the ventral portion of the DRN near, or between, the medial longitudinal 
bundles. The “complete” type of serotonergic medullary neurons is evenly distributed in 
the medullary 5-HT cell groups, whereas the “incomplete” type is mainly located in the 
nucleus raphe pallidus. The suppression of discharge of type II-B DRN neurons seen dur- 
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ing W appears to result from the activation of serotonergic autoreceptors, whereas the re¬ 
duction or suppression of discharge during sleep of both typical and atypical serotonergic 
DRN neurons is caused by the withdrawal of excitatory drives (disfacilitation) resulting 
from cessation of discharge of norepinephrine, histamine and, to a lesser extent, orexin 
(hypocretin) (Orx/Hcrt) neurons during sleep. A similar disfacilitation mechanism appears 
to operate for caudal raphe neurons. These data suggest that different roles are played by 
brainstem serotonergic neurons in behavioral state control, functional topographic orga¬ 
nization, and adrenergic, histaminergic, and/or orexinergic tonic control of serotonergic 
neurons during wake-sleep states. 


Introduction 

Serotonin (5-hydroxytriptamine, or 5-HT), one of several biogenic amines 
widely distributed within the central nervous system (CNS), plays important 
roles in a wide variety of cognitive and behavioral functions [1, 2], Nine groups 
of 5-HT-containing cell bodies have been described in the brainstem and were 
designated as B1 -B9 by Dahlstrom and Fuxe (1964) [3], The vast majority of 
5-HT neurons are located on, or near, the midline, especially in the raphe nuclei 
(77.5% in the cat) [4], while the remaining neurons extend laterally from the 
midline to occupy dorsolateral or ventrolateral regions of the reticular core [3, 
4], Rostral 5-HT neuron groups, in particular groups B7 and B8, correspond¬ 
ing, respectively, largely to the nuclei raphe dorsalis (DRN) or medianus or 
centralis superior (NCS), constitute the main source of widespread ascending 
serotonergic projections to the forebrain, whereas caudal 5-HT neuron groups 
such as Bl, B2, and B3, corresponding, respectively, largely to the nuclei raphe 
pallidus (RPa), obscurus (ROb), or magnus (RM), innervate the brainstem and 
spinal cord. It is generally believed that 5-HT neurons in the raphe nuclei dis¬ 
play stereotypical behavior during sleep-waking cycles, discharging tonically 
and regularly at a high rate during waking (W) and at progressively slower rates 
during slow-wave sleep (SWS) and exhibiting virtually complete cessation of 
discharge during paradoxical sleep (PS), also known as rapid eye movement 
(REM) sleep [1], This led to the proposition that 5-HT neurons play a role 
as waking-neurons and have global effects on various physiological functions. 
Recent anatomical studies have demonstrated that projections from the rostral 
5-HT neuron groups comprise multiple subsystems that have a high degree of 
specificity in their organization [1,5], suggesting that 5-HT neurons may have 
not only global effects on various CNS functions, but also more specific, in¬ 
dependent actions. Previous studies [6-9] and our recent single-unit recording 
studies [10, 11] in freely moving animals have revealed several populations of 
atypical 5-HT neurons in the rostral raphe nuclei, in agreement with anatomi¬ 
cal findings, suggesting both the diversity and specificity of the role of 5-HT 
in brain functions [1, 5], The main purpose of the present review is to describe 
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the unitary characteristics of these typical and atypical 5-HT neurons during 
behavioral states, the mechanisms underlying their neuronal modulation dur¬ 
ing the sleep-waking cycle, and the possible functions of 5-HT neurons in the 
regulation of sleep and wakefulness. 


General characteristics of presumed 5-HT neurons 
in conscious animals 


Early extracellular recordings from neurons within the DRN of anesthetized 
rats revealed a distinctive population of neurons exhibiting a slow and rhyth¬ 
mic firing pattern [12], The serotonergic nature of these neurons was then dem¬ 
onstrated by intracellular recording followed by neurochemical identification 
of the neurons. Serotonergic DRN neurons have been shown to display a wide 
action potential, pronounced post-spike after-hyperpolarization (AHP), and 
a depressant response to 5-HT 1A agonists (for a review, see [1]). On the basis 
of these characteristic physiological and pharmacological properties and their 
anatomical location, 5-HT neurons in the raphe nuclei have been tentatively 
identified in single-unit recording studies in conscious animals, especially the 
cat [1], 

The classical criteria used to distinguish presumed serotonergic neurons are: 
(1) an action potential of long duration (>2 ms); (2) slow, rhythmic discharge 
activity; (3) cessation of discharge during PS; (4) a depressant response to 
5-HT 1A agonists; and (5) histological localization of recording sites to a 5-HT 
neuron field [1], 

On extracellular recording in anesthetized or conscious animals using 
either glass or microwire electrodes, all presumed brainstem 5-HT neurons 
display a characteristic bi- or triphasic action potential of long duration 
(Fig. la, 1 and 2) [6, 9, 11, 13-15], as is the case for serotonergic DRN neu¬ 
rons recorded in rat brain slices [16], These characteristics are quite similar 
to those of other aminergic (noradrenergic, dopaminergic, histaminergic, 
and cholinergic) neurons [17], but differ from those of presumed non-5-HT 
neurons found within the raphe nuclei (Fig. lb, 1 and 2) [11, 14, 16], This 
typical action potential form of presumed serotonergic neurons can be used 
as a defining feature of 5-HT neurons in the raphe nuclei, as is the case for 
cholinergic and histaminergic neurons recorded in vivo [18, 19], As with other 
monoamine neurons, all presumed 5-HT neurons are characterized by a slow 
discharge rate (<9 Hz). In general, 5-HT neurons located in the medulla ex¬ 
hibit a higher rate of spontaneous discharge than those located in the midbrain 
and pons. (Fig. 2) [6, 7, 20], 

Most typical presumed 5-HT neurons display a notable regularity of spike 
trains, as shown by an interspike interval histogram with a unimodal and sharp 
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Fig. 1 Averaged spike shapes of presumed serotonergic (a) and non-serotonergic (b) 
DRN neurons and autocorrelograms of presumed serotonergic neurons in the nuclei 
raphe dorsalis (c) and pallidus (d). Note the characteristic tri- (al) or bi-phasic (a2) 
broad action potential seen in the presumed serotonergic DRN neurons. The arrow in 
Al indicates the hump of the triphasic action potential. Also note the clock-like regular 
firing of typical presumed serotonergic neurons, as shown by sharp, regular peaks and 
the small coefficient of variation (CV) of the spike interval. 


peak or an autocorrelation histogram with sharp and regular peaks (Fig. 1, 
c and d) [9, 11], When the coefficient of variation (CV) of the discharge in¬ 
terval (standard deviation/mean discharge interval) is used as a quantitative 
measure of the regularity of discharge during quiet waking (QW), typical 
presumed 5-HT neurons have a small CV (<0.4-0.5) [8, 11] (Fig. 1, c and d). 
However, many other presumed 5-HT neurons with the characteristic action 
potential form do not display such a regular, clock-like firing pattern under 
normal physiological conditions. In addition, subpopulations of presumed 
non-5-HT neurons in the raphe nuclei display a slow (<9 Hz) and regular 
(CV <0.4) pattern of discharge during W [11, 15], The characteristics of the 
discharge pattern during W, therefore, cannot be used as a discriminative cri¬ 
terion. As illustrated in Fig. 3, all presumed 5-HT neurons, characterized by 
a broad action potential and slow firing pattern, exhibit a reduction or com¬ 
plete suppression of the spontaneous discharge rate during PS, a characteristic 
also seen in norepinephrine (NE)-containing neurons in the locus coeruleus 
and histamine (HA)-containing neurons in the posterior hypothalamus. These 
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AW QW SWS- SWS+ PS- PS+ 

Fig. 2 Mean (± SEM) rates of spontaneous discharge during the sleep-waking cycle for 
type I-A (black columns) and type I-B (white columns) serotonergic neurons in the DRN 
(upper panel) and the complete (black columns) and incomplete types (white columns) 
of presumed serotonergic medullary neurons (lower panel). AW, active waking; QW, 
quiet waking; SWS-, slow-wave sleep without PGO waves; SWS+, SWS with PGO waves; 
PS-, PS episode without PGO waves; PS+, PS episode with PGO bursts 
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neurons are therefore collectively referred to as PS-off or REM-off neurons 
[17]. The majority of presumed 5-HT neurons exhibit complete suppression 
of discharge during PS, but a minority does not (Fig. 3) [6, 7, 9, 11, 20, 21], In 
contrast, most presumed non-serotonergic neurons in the raphe nuclei, char¬ 
acterized by a narrow action potential and fast discharge rate, display either a 
phasic or tonic increase in spontaneous firing rate during PS compared to SWS 
[7, 9, 11], This PS-off property appears to be useful for distinguishing 5-HT 
from non-5-HT neurons in the rostral raphe nuclei [11], but cannot be used 
in the caudal raphe nuclei, which contain presumed non-serotonergic PS-off 
neurons [15]. When tested in conscious cats, all presumed 5-HT neurons display 
a reduction or complete suppression of spontaneous discharge following local 
or systemic application of 5-HT 1A autoreceptor agonists, whereas neighboring 
presumed non-5-HT neurons are either unresponsive or increase their spon¬ 
taneous discharge rate [6, 9, 11, 13, 15, 22, 23], In general, medullary 5-HT 
neurons are less responsive to 5-HT 1A agonists than rostral raphe 5-HT neu¬ 
rons, both in vitro and in vivo [13, 24], There are some inconsistencies in the 
literature regarding the response to 5-HT 1A receptor activation. Although pre¬ 
sumed non-5-HT raphe neurons do not display a depressant response to 5-HT 
agonist administration in conscious cats (see above), a recent study on in vitro 
rat brain slices reported that virtually all identified 5-HT and non-5-HT DRN 
neurons are uniformly hyperpolarized by 5-CT, a non-selective 5-HT agonist 
[25], However, in anesthetized or conscious rats, both positive and negative re¬ 
sponses have been reported for presumed non-5-HT neurons after application 
of 5-HT or 8-OH-DPAT, a selective 5-HT 1A agonist [14, 26], When identified 
antidromically, presumed 5-HT neurons invariably show slow axonal conduc¬ 
tion velocities, a characteristic of fine, non-myelinated 5-HT axons, whereas 
most neighboring presumed non-5-HT neurons display higher conduction ve¬ 
locities, indicative of myelinated axons [11, 15]. This conduction velocity crite¬ 
rion should be used with caution for DRN neurons, since the DRN contains 
dopaminergic neurons that may exhibit similar slow conduction velocities. 
Summing up, the basic electrophysiological and pharmacological features of 
presumed 5-HT neurons in conscious animals appear to be: (1) a characteristic 
bi- or triphasic action potential of long duration; (2) a slow and tonic pattern 
of discharge activity during W; (3) a reduction in spontaneous discharge rate 
during PS; (4) a depressant response to 5-HT IA receptor agonists; and (5) a 
slow conduction velocity. In the present review, therefore, individual brainstem 
neurons are identified as serotonergic, and referred to as serotonergic or 5-HT 
neurons, when they meet the above criteria. However, no definitive proof of the 
serotonergic nature of the neurons was provided in any of the previous unit 
recording studies in vivo. Further intracellular or juxtacellular recordings and 
single cell labeling in conscious animals are therefore required to establish their 
serotonergic nature. 
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Fig. 3 Polygraphic recordings (a) and schematic representation (b) of the unit activity of 
different types of presumed serotonergic neurons in the DRN and medulla. EMG, neck 
muscle electromyogram; EEG, neocortical electroencephalogram; PGO, dorsal lateral 
geniculate EEG showing PGO waves; EOG, electrooculogram. The arrow on the EEG 
trace in (a) indicates a brief interruption of the PS episode, as seen by sleep spindles and 
the absence of PGO waves 
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Classification of brainstem 5-HT neurons 

Fig. 3 shows schematic drawings of the unit activity of 5-HT neurons in the 
DRN and medulla across the sleep-waking continuum. As shown in this figure, 
5-HT neurons in the DRN are particularly heterogeneous and can be divided 
into type I or type II according to their regular (clock-like) or irregular (non- 
clock-like) firing pattern. Both types I and II are further divided into three sub¬ 
groups (types I-A, I-B, and I-C and types II-A, II-B, and II-C) according to 
differences in their firing patterns during the sleep-waking cycle [11], On the 
other hand, medullary 5-HT neurons can be divided into “complete” type and 
“incomplete” type according to their cessation or persistence, respectively, of 
spontaneous discharge during PS [6, 20, 21]. 


Rostral 5-HT neurons 
Types I-A and I-B 

Of 240 serotonergic DRN neurons recorded during complete sleep-waking cyc¬ 
les, 95 (40%) and 65 (27%) were classified as types I-A and I-B, respectively [11], 
They appeared to be identical to those described as 5-HT neurons by many pre¬ 
vious authors [1, 8, 27-30], As shown in Fig. 4, they were evenly distributed 
within the DRN and displayed a regular firing pattern, as substantiated by their 
low CY for the spike interval (CY <0.5). The activity of these neurons were 
closely related to the level of behavioral arousal, discharging at a high rate dur¬ 
ing W and at progressively slower rates during SWS, and exhibiting nearly com¬ 
plete or complete suppression of discharge during PS (Fig. 2). However, they dif¬ 
fered in the occurrence of ponto-geniculo-occipital (PGO) waves, a phasic activ¬ 
ity characteristic of PS. Type I-A neurons cease firing prior to the occurrence of 
PGO waves and remain virtually silent during SWS accompanying PGO waves, 
whereas the activity of type I-B neurons does not correlate with PGO waves and 
they show tonic discharge during SWS with PGO waves (Figs. 2, 3, and 5). No 
significant relationship was seen between their unit discharge and sleep spin¬ 
dles. Forty-nine percent of type I-A neurons and 34% of type I-B neurons re¬ 
sponded antidromically to stimulation of the medial forebrain bundle, the main 
ascending serotonergic pathway, with mean (± SD) conduction velocities of, re¬ 
spectively, 0.85±0.49 m/s and 1.00±0.63 m/s. Although, in general, serotonergic 
DRN respond to both auditory and visual stimuli [7], most DRN neurons with 
a clock-like discharge pattern are unresponsive or much less responsive to sen¬ 
sory stimulation than non-clock-like DRN neurons [8, 31], Similarly, in freely 
conscious rats, regularly firing presumed serotonergic DRN neurons are rela¬ 
tively insensitive to specific sensory and motor challenges compared to irregu¬ 
larly firing presumed non-serotonergic DRN neurons [26], 5-HT neurons in the 
NCS appear to be very much like type I-A or I-B DRN neurons in their activity 
during the sleep-waking cycle [9,23], Like DRN 5-HT neurons, NCS 5-HT neu¬ 
rons are, in general, responsive to both phasic auditory and visual stimuli [9], 
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Fig. 4 Localization of different types of presumed serotonergic and non-serotonergic 
neurons recorded in the DRN. Types I-A, I-B and I-C, presumed serotonergic regular¬ 
ly discharging neurons; Types II-A, II-B and II-C, presumed serotonergic irregularly 
discharging neurons; Tonic types I-S, I-R, and Phasic, presumed non-serotonergic slow¬ 
ly (type I-S) or rapidly discharging (type I-R) tonic neurons and phasically discharging 
(phasic) neurons, respectively. 3, oculomotor nucleus; An, nucleus annularis; BC, brachi- 
um conjunctivum (modified from [11]) 
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Type C 

As with types I-A and I-B, type C neurons (6%) were found to display a slow, 
regular firing pattern during W. However, unlike types I-A and I-B, they main¬ 
tained a high level of regular tonic activity during both SWS and PS, although 
a significant reduction in spontaneous discharge rate was seen during both 
SWS with PGO waves and PS compared to during QW (Fig. 3). Their activity 
showed no correlation with the occurrence of sleep spindles and PGO waves, 
and they were mainly located in the ventral region of the DRN (Fig. 4). Only 
one out of ten neurons tested was identified antidromically by stimulation of 
the ascending 5-HT bundle, with a slow conduction velocity of 1.14 m/s. Some 
5-HT neurons that are very similar to type I-C neurons in discharge pattern 
have been reported previously by Rasmussen et al. [9] between the medial lon¬ 
gitudinal bundles, a region representing the caudal interface of the NCS and 
the DRN. 


Type II-A 

Type II-A neurons (8%) were mainly located in the middle portion of the 
DRN (Fig. 4) and were characterized by their irregular pattern of spike trains 
(CV >0.5) and the relationship to motor activity (Fig. 3). They discharged at 
a high rate during active waking (AW), feeding, and grooming, and displayed 
a marked reduction in discharge rate during both QW and light SWS, charac¬ 
terized by sleep spindles and an intermittent synchronous EEG. They ceased 
firing prior to the occurrence of PGO waves (Fig. 5) and remained silent dur¬ 
ing SWS with PGO waves and PS (Fig. 3). The unit activity of these neurons 
therefore displays an inverse relationship with the occurrence of sleep spindles 
and PGO waves, as is the case for DRN neurons previously described as typical 
5-HT neurons [30], Thirty-three percent of type II-A neurons responded anti¬ 
dromically to stimulation of the ascending 5-HT bundle, with a mean conduc¬ 
tion velocity of 1.56±0.97 m/s. 


Type II-B 

Type II-B neurons (12%) were characterized by displaying their highest dis¬ 
charge rate during deep SWS and suppression of discharge during both W and 
PS (Figs. 3 and 6). This subgroup was localized in the most rostral and dorsal 
portion of the DRN, near the oculomotor nucleus (Fig. 4). Their unit activ¬ 
ity exhibited no correlation with the occurrence of sleep spindles and PGO 
waves. Forty-two percent of neurons responded antidromically to stimulation 
of the ascending 5-HT bundle, with a slightly faster conduction velocity of 
1.71 ±0.55 m/s, significantly different (p<0.01) from that of typical serotonergic 
type I-A or type I-B neurons. As shown in Fig. 6, the majority of type II-B neu- 
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rons remained quiescent during both QW and AW, but were strongly activated 
during feeding and grooming. The spontaneous discharge rate increased on go¬ 
ing from QW to light SWS and on going into deep SWS, but they completely 
ceased firing during PS and remained silent even after the end of PS until the 
occurrence of SWS (Fig. 3). An inverse relationship was therefore noted in unit 
activity between type II-B and type I-A neurons during QW and SWS and dur¬ 
ing the transition from PS to W [11], 


Type II- C 

Type II-C neurons (8%) showed slow, irregular firing during W, and displayed 
reduced, but significant, discharge during PS (Fig. 3). Like type I-C neurons, 
they were located in the ventral portion of the DRN near the medial longitu¬ 
dinal bundle and the nucleus annularis (Fig. 4). Nineteen percent of type II-C 
neurons responded antidromically to stimulation of the ascending 5-HT bun¬ 
dle, with a slow conduction velocity of 1.39±0.53 m/s. 

Summing up, these data suggest a marked heterogeneity of DRN 5-HT neu¬ 
rons and their functional topographical organization within the nucleus. 
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Fig. 5 Peri-PGO wave time histograms for presumed serotonergic DRN (types I-A, I-B, 
and II-A) and medullary (complete) neurons. Note the cessation of discharge prior to 
the occurrence of PGO waves seen specifically in type I-A and type II-A neurons 
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Fig. 6 Polygraphic traces showing the unitary characteristics of a type II-B neuron 
during the sleep-wake states. Note the complete suppression of unit discharge during 
both PS (a) and active and quiet waking (b2), but not during feeding (indicated as f in 
trace (a), and (bl)) and grooming (indicated as g in trace (a)). The polygraphic recor¬ 
dings during feeding, AW and QW, and SWS, indicated as 1, 2, and 3, respectively, in 
trace A, are shown expanded in traces (bl), (b2), and (b3), respectively. Also note the 
gradual increase in discharge rate on going from QW to light SWS and the high level 
of sustained tonic activity seen during deep SWS (a). The arrow in trace (b3) indicates 
onset of PS (modified from [11]) 


Caudal 5-HT neurons 

As with the rostral raphe 5-HT neurons, medullary 5-HT neurons displayed a 
state-dependent pattern of unit activity (Fig. 2). However, none showed a sig¬ 
nificant change in unit activity in relation to sleep spindles and PGO waves 
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(Fig. 5). The majority (78%) displayed complete cessation of discharge dur¬ 
ing PS (referred to as complete type), whereas the remaining 22% retained their 
tonic discharge during this state (referred to as incomplete type) (Figs. 2 and 7). 
This incomplete type of neurons, however, displayed reduction or suppression 
of discharge in relation to bursts of rapid eye movements (REM) and PGO 
waves occurring during PS episodes (84% mean reduction in firing rate relative 
to QW) (Figs. 2 and 7) [15, 20], In this respect, they differ from type I-C and II- 
C DRN neurons, which show no significant decrease in discharge rate in associa¬ 
tion with PGO/REM bursts. Out of 61 complete type of neurons, 7 responded 
antidromically to stimulation of a descending 5-HT pathway, with a mean con¬ 
duction velocity of 0.9±0.3 m/s [15]. Although both types of medullary neu¬ 
rons were found in the RM and RPa, and also in the ventrolateral medulla and 
between the medial longitudinal bundles, the incomplete type of neurons was 
mainly found in the RPa (Fig. 8) [7, 21], Recent studies have revealed several 
subgroups of presumed serotonergic neurons in the medulla that respond dif¬ 
ferently to sensory and/or motor challenges (for a review, see [32]), suggesting a 
heterogeneity of medullary 5-HT neurons. Further studies are needed to estab¬ 
lish the possible functional organization within the caudal 5-HT cell groups. 
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Fig. 7 Unit activity of two putative serotonergic neurons in the medulla during different 
sleep-wake states. Note there is either complete cessation of discharge ((a), complete 
type) or transient suppression of sustained discharge in association with rapid eye move¬ 
ment (EOG) and PGO wave (LGN) bursts ((b), Incomplete type) (modified from [15]) 

















218 


Kazuya Sakai 






































Electrophysiological studies on serotonergic neurons and sleep 


219 


◄ Fig. 8 Drawings of frontal sections showing (left panels) the location of 5-HT-im- 
munoreactive neurons (indicated by circles) or (right panels) presumed serotonergic 
(complete or incomplete type neurons indicated as empty or filled circles, respectively) 
and non-serotonergic (asterisks) PS-off neurons in the medulla. 6, abducens nucleus; 
7, facial nucleus; 5SP, alaminar spinal trigeminal nucleus; Gc, Me, and Pc, nuclei reti¬ 
cularis gigantocellularis, magnocellularis, and parvocellularis, respectively; IO, inferior 
olivary complex; PGCL, nucleus paragigantocellularis lateralis; LM, medial lemniscus; 
mlf, medial longitudinal bundle; RM, RPa, and ROb, nuclei raphe magnus, pallidus and 
obscurus, respectively; RFN, retrofacial nucleus; rs, reticulospinal tract; s, solitary tract. 
P6-P9 indicate anteroposterior stereotaxic planes 


Neuromodulation of serotonergic DRN neurons during 
sleep-waking states 


Antidromic experiments 

All brainstem 5-HT neurons are characterized by a reduction in spontaneous 
discharge rate during PS. Is this reduction of spontaneous activity due to tonic 
inhibition or disfacilitation? In an attempt to examine the neuronal excitability 
of serotonergic neurons during the sleep-waking cycle, we used the antidromic 
latency technique [33], This is based on the principle that the delay between 
the stimulus and the somatodendritic (SD) component of the antidromic spike 
invariably depends on the soma membrane polarization, with soma membrane 
hyperpolarization (indicative of inhibition or disfacilitation) increasing the de¬ 
lay, and depolarization (indicative of excitation or disinhibition) shortening it 
[34], It has been shown, for example, that lumbar and trigeminal motoneurons 
are hyperpolarized as a result of postsynaptic inhibition during both PS and 
motor inhibition induced by carbachol, a potent cholinergic agonist, and that, 
during these states, there is either a marked prolongation of antidromic latency 
or a complete blockade of the SD spike [35, 36], 

We found that, in freely moving cats, all serotonergic DRN neurons tested 
displayed both a reduction in the magnitude and variability of antidromic la¬ 
tency and an increase in antidromic responsiveness during PS compared to 
during other behavioral states (Fig. 9), suggesting an increase in neuronal excit¬ 
ability of serotonergic DRN neurons during PS. These findings are inconsistent 
with the assumption that the cessation of discharge of serotonergic DRN neu¬ 
rons seen during PS is due to strong inhibition. The marked prolongation of 
antidromic latency and variability seen during QW and SWS seems to be due to 
the prominent post-spike AHP, whereas the reduction seen during PS appears 
to be due to the mechanism of disinhibition as a result of the removal of the 
marked AHP that follows each action potential, an intrinsic property of 5-HT 


220 


Kazuya Sakai 



Antidromic Latency (ms) 


b 






Fig. 9 Antidromic latency variation during wake-sleep states, (a) Antidromic action po¬ 
tentials seen during W, SWS, and PS (three superimposed sweeps). The vertical dotted 
line represents the onset of the initial segment (IS) spike. Note that the change in antid¬ 
romic latency results from a change in the delay between the IS and somatodendritic (SD) 
spikes, (b) Antidromic responses of a serotonergic DRN neuron during wake-sleep states 
following stimulation of the main ascending 5-HT pathway. The upper trace shows dot 
displays of the antidromic latency, while the lower trace show the spontaneous discharge 
rate (spikes/s) after removal of the antidromic spike responses and stimulus artifacts. 
Note the decrease in the magnitude and variability of the antidromic latency during PS, 
and the SWS episodes with reduced spontaneous discharge activity. Also note the gradu¬ 
al shortening of the antidromic latency seen during PS (modified from [33]) 


neurons. Interestingly, a gradual shortening of the antidromic latency was seen 
during PS (Fig. 9), suggesting gradual depolarization of the soma membrane 
during this sleep state. This depolarization associated with cessation of spon¬ 
taneous discharge might represent a restorative process of serotonergic DRN 
neurons [33], 


Mechanisms of disfacilitation 

Rostral raphe neurons 

Most serotonergic DRN neurons do not fire spontaneously in the absence of 
synaptic input in vitro [37-41], suggesting that either an inhibitory or disfa- 
cilitatory mechanism may underlie the inactivation of serotonergic DRN unit 
activity during PS. Two excitatory and two inhibitory synaptic potentials have 
been previously described in DRN slice preparations; the former are glutamate 
(Glu)-mediated fast and NE-mediated slow synaptic potentials and the latter 
GABA-mediated fast and 5-HT-mediated slow synaptic potentials. In addi¬ 
tion, recent studies have revealed two addition excitatory inputs to serotonergic 
DRN neurons arising, respectively, from HA-containing and Orx/Hcrt-con- 
taining neurons of the posterior hypothalamus [42, 43], 
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Fig. 10 Effects of microdialysis application of muscimol, a GABA a receptor agonist, 
and bicuculline, a GABA a receptor antagonist, on a typical serotonergic DRN neuron 
during the sleep-waking cycle. Note the virtually complete suppression of spontane¬ 
ous discharge activity during application of 100 pM muscimol and its total reversal by 
200 pM bicuculline. Also note that bicuculline alone does not attenuate the cessation 
of activity seen during PS. The bars under the drug name indicate the drug application 
period 


Previous studies established that activation of 5-HT 1A autoreceptors by 
5-HT agonists inhibits the spontaneous firing of serotonergic DRN neurons 
[1], However, the cessation of discharge of serotonergic DRN neurons during 
PS does not seem to be due to 5-HT-mediated autoinhibition, since systemic 
administration of WAY-10063 5, a specific 5-HT 1A autoreceptor antagonist, 
does not attenuate this phenomenon [10, 44], Similarly, GABA-mediated in¬ 
hibition does not seem to be responsible for cessation of DRN neuronal firing 
during PS, since iontophoretic [45] or local [10, 11] application of bicuculline 
at concentrations that can completely reverse the potent depressant effect of 
muscimol, a potent GABA a agonist, does not reverse DRN neuronal depres¬ 
sion during PS (Fig. 10); see, however, [46]). Glu-mediated disfacilitation does 
not seem to be responsible for serotonergic DRN neuronal depression during 
PS, since the spontaneous activity of serotonergic DRN neurons is unaffected 
by iontophoretic or microdialysis application of excitatory amino acid antago¬ 
nists [10,45], 

As described above, serotonergic DRN neurons receive excitatory afferent 
projections from three different arousal systems, the noradrenergic, histaminer- 
gic, and orexinergic systems, which act, respectively, through postsynaptically 
located a t , H 1; and OX, and OX 2 receptors [43], In brain slices, silent 5-HT 
neurons have been reported to fire in a slow and rhythmic manner in the pres¬ 
ence of phenylephrine (PE), a selective a, adrenoceptor agonist [16, 47], Ac¬ 
cording to a recent study [43], serotonergic DRN neurons receive convergent 
excitatory inputs from these arousal systems through common effector mecha¬ 
nisms: when the effector systems are fully activated by one of the systems, the 
other systems have no effect on the firing of 5-HT neurons (occlusion). How- 
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ever, in freely moving cats, DRN 5-HT neurons appear to be largely controlled 
by the histaminergic or noradrenergic system, as application of mepyramine, 
a specific Hj histamine receptor antagonist, or prazosin, a specific a, adreno¬ 
ceptor antagonist, results in almost complete suppression of the spontaneous 
discharge of DRN neurons during QW (Fig. lib) [10]. Conversely, the cessa¬ 
tion of discharge of both typical and atypical serotonergic DRN neurons seen 
during sleep is completely blocked by application of either HA (Fig. 11a) or 
PE (Fig. 12) [10, 11], In addition, even atypical serotonergic DRN neurons ex¬ 
hibiting irregular discharge activity change to a regular firing pattern following 
application of PE or HA [11], Interestingly, in freely moving cats, individual 
serotonergic DRN neurons respond either to HA or PE, but not both, sug¬ 
gesting differential control of serotonergic DRN neurons by histaminergic and 
noradrenergic systems [10]. The reduced level of spontaneous firing of seroto¬ 
nergic DRN neurons during sleep therefore appears to be caused by disfacili- 
tation due to the functional removal of tonic noradrenergic or histaminergic 
inputs to these neurons. It should be mentioned, however, that the activity of 
serotonergic DRN neurons is never completely suppressed by mepyramine or 
prazosine in awake freely moving cats [10, 48], suggesting additional excitatory 
inputs impinging upon DRN neurons during this behavioral state. One of these 
excitatory inputs may originate from the orexinergic arousal system. 

In vitro experiments have demonstrated that some serotonergic DRN neu¬ 
rons exhibit a regular pattern of spontaneous firing in brain slices and have an 
intrinsic pacemaker property, characterized by a pronounced AHP, followed 
by a gradual interspike depolarization leading to the succeeding spike [49], It 
is not known whether atypical serotonergic DRN neurons maintaining a slow, 
rhythmic activity throughout the sleep-waking cycle (type I-C) correspond to 
these serotonergic neurons, which are spontaneously active in vitro. 

Finally, it should be mentioned that the cessation of discharge of sleep-ac¬ 
tive type II-B neurons during W is blocked by application of WAY-100635, 
suggesting that it may be caused by 5-HT 1A autoreceptor-mediated inhibition 
[11]. Conversely, the increased discharge rate of type II-B neurons seen during 
sleep may be due to 5-HT 1A -mediated disinhibition, since application of WAY- 
100635 resulted in a significant increase in the basic discharge rate during both 
W and SWS in all type II-B neurons studied, whereas only the increase during 
W was seen in other serotonergic DRN neurons [11, 50]. 
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Fig. 11 Effects of adrenergic and histaminergic drugs on serotonergic DRN neurons, 
(a) Polygraphic traces showing lack of effect of phenylephrine, a selective a, adrenoceptor 
agonist, and effect of histamine on two simultaneously recorded DRN neurons (U048 & 
U049) during the sleep-waking cycle. Microdialysis application of phenylephrine has no 
effect, whereas histamine produces complete blockade of DRN unit suppression during 
PS in the same neuron, (b) Effects of mepyramine, a specific H, receptor antagonist, on a 
presumed serotonergic DRN neuron during different behavioral states. Note the comple¬ 
te suppression of spontaneous discharge activity during application of 5 mM mepyra¬ 
mine and the total reversal of DRN unit depression by 5 mM histamine. The bars under 
the drug name indicate the drug application period (modified from [10]) 
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Fig. 12 Effects of microdialysis application of 200 pM phenylephrine on a presumed 
serotonergic DRN neuron during the sleep-waking cycle. Note the reduction of the unit 
discharge during PS before, and at the start of, drug application (indicated as 1 in trace 
(a) and shown expanded in trace (bl)) and the complete blockade of this suppression 
in the late phase of drug application (indicated as 2 in trace (a) and shown expanded 
in trace (b2)). The bar under the drug name in (a) indicates the drug application period 
(modified from [10]) 
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Caudal raphe neurons 

Little is known about the mechanisms underlying the neuromodulation of se¬ 
rotonergic medullary neurons across the wake-sleep states. It should first be 
mentioned that serotonergic caudal raphe neurons cease firing during both PS 
and carbachol-induced atonia, even in chronically maintained cats with mid¬ 
brain transection (“cerveau isole preparation”) (Fig. 13a) [51, 52], indicating 
that the basic mechanisms underlying the cessation of discharge of caudal ra¬ 
phe neurons during PS and during carbachol-induced atonia occur in the lower 
brainstem. Like rostral serotonergic raphe neurons, most serotonergic RM 
neurons do not fire spontaneously in slice preparations [53, 54], They receive 
afferent projections from both adrenergic and noradrenergic neurons located 
in the pons and medulla and are activated through a, adrenoceptors [55], It 
therefore seems likely that disfacilitation mechanisms similar to those seen with 
serotonergic DRN neurons are operative for the tonic reduction or suppres¬ 
sion of discharge of these medullary neurons during PS, although the activity 
of adrenergic and noradrenergic medullary neurons during the sleep-waking 
cycle is not yet known. In addition to serotonergic PS-off neurons, the medulla 
contains presumed non-catecholaminergic and non-serotonergic PS-off neu¬ 
rons, some of which are located in the raphe nuclei (Fig. 8). In contrast to se¬ 
rotonergic PS-off neurons, these display a narrow action potential, a high rate 
of spontaneous regular discharge during QW, a fast conduction velocity, an 
excitatory response to 5-HT 1A agonists, and short phasic discharges with REM 
and PGO wave bursts [15]. The medulla also contains PS-on neurons showing 
a high rate of tonic discharge just prior to, and during, PS (Fig. 13b) [56-58], A 
cholinergic, glutamatergic, or GABAergic nature has been suggested for pon¬ 
tine and medullary PS-on neurons implicated in PS generation [59], It should 
be mentioned that serotonergic RM neurons are reported to be hyperpolar- 
i/ed by applied GABA and cholinergic agonists in vitro [54], There is a mirror 
image, or exactly inverse, relationship in terms of cellular discharge between 
PS-on and serotonergic PS-off neurons throughout the sleep-waking cycle, sug¬ 
gesting a mutual inhibitory interaction between these two neuronal popula¬ 
tions [58], This inverse relationship in discharge activity is clearly seen between 
PS-on neurons and the incomplete type of serotonergic PS-off neurons during 
PS episodes marked by the presence of REM and PGO wave bursts. These data 
suggest the possibility of multiple interactions between PS-on and monoami- 
nergic and non-monoaminergic PS-off neurons within the medulla and that the 
decrease in discharge activity of medullary 5-HT neurons may be due to the 
mechanisms of both inhibition and disfacilitation. 

Unlike serotonergic RM neurons, most serotonergic neurons in the RPa and 
ROb exhibit a slow and irregular spontaneous discharge pattern in vitro [53], 
The sustained tonic pattern of discharge seen during PS in RPa and ROb neu¬ 
rons might be due to their intrinsic pacemaker property. 
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Fig. 13 Single-unit activities recorded in the medulla of cats with midbrain transection, 
(a) Polygraphic traces showing two simultaneously recorded raphe magnus (RM) neu¬ 
rons exhibiting either reduction or cessation of discharge during PS (PS-off neurons): 
they are, respectively, a presumed non-5-HT neuron (Unit: 02434) and a presumed 5-HT 
neuron (Unit: 02433). Also note the high (non-5-HT) or low (5-HT) rate of spontaneous 
regular discharge during the quiescent state and the increase in discharge rate with body 
movements that accompany a transient increase in blood pressure (BP) (indicated by 
arrows), (b) Polygraphic traces showing a non-5-HT RM neuron exhibiting a marked 
increase in discharge rate just prior to, and, during PS (PS-on neuron). PGO, abducens 
nucleus (n. VI) EEG showing pontine PGO waves (modified from [51]) 
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Functional role of serotonergic neurons 
in behavioral state control 


Rostral 5-HT neurons sending axons to the forebrain are divided into typical 
and atypical groups. The typical 5-HT neurons are located evenly in the rostral 
raphe nuclei and display a stereotypical state-dependent behavior, leading to the 
postulates that the activity of serotonergic DRN neurons is generally related to 
the level of behavioral arousal [1] and that a depression in DRN serotonergic 
activity promotes and maintains PS [60-62], In general, typical serotonergic 
neurons with a regular, clock-like pattern of tonic discharge do not respond, 
or are only minimally responsive, to a wide variety of physiological and behav¬ 
ioral stimuli, whereas the majority of atypical serotonergic neurons exhibiting 
an irregular, non-clock-like pattern of tonic discharge are more responsive to 
environmental or physiological challenges [1, 8, 63], It therefore appears that 
the regularly firing typical serotonergic neurons in the rostral raphe nuclei may 
play more general and global physiological roles than the atypical serotonergic 
neurons, which may exert more specific, independent effects on brain functions, 
such as attention, vigilance, and mood. Like DRN 5-HT neurons, medullary 
5-HT neurons exhibit either complete cessation or tonic reduction of firing 
rate just before, and during, PS, a state characterized by profound muscle in¬ 
hibition. It is well established that 5-HT neurons in the medulla and caudal 
DRN innervate spinal and cranial motoneurons and that 5-HT enhances the 
excitability of these motoneurons (for a review, see [64]). Sustained tonic firing 
of medullary and a subgroup of DRN neurons may help maintain the overall 
level of excitability of motoneurons (see below). Further comprehensive analy¬ 
sis of the responses of each subgroup of 5-HT neurons to various challenges is 
needed for a better understanding of their role in brain function. 


5-HT neurons and PS generation 

It is generally believed that the activity of serotonergic DRN neurons sup¬ 
presses PS via inhibition of PS-on or REM-on neurons [17, 60, 65] and sup¬ 
presses PGO waves via inhibition of PGO-generator neurons [29, 66-68], 
However, the role of serotonergic DRN neurons in PS generation in general is 
controversial, because they display complete suppression of spontaneous dis¬ 
charge during the atonic-waking state induced by carbachol [69], and, in the cat 
exhibiting PS without atonia after bilateral lesioning of the mediodorsal pons, 
serotonergic DRN neurons do not cease firing during PS [70], indicating that 
the cessation may be primarily associated with the muscle atonia. DRN lesions 
or suppression of neuronal activity of serotonergic DRN neurons do not lead 
to any increase in PS amount [71-73] (see however [62]). Both mesopontine 
PS-on neurons showing tonic discharge specific to PS and PGO-on neurons 


228 


Kazuya Sakai 


exhibiting a burst of activity critical to PGO wave generation are insensitive 
to iontophoretically applied 5-HT [74, 75], In addition, 5-HT has no effect on 
PS and PGO wave generation when applied by microdialysis to any part of 
the mesopontine tegmentum [76], a region critically implicated in the genera¬ 
tion of PS and PGO waves and which receives the major serotonergic afferent 
projections from the DRN [77], DRN neurons projecting to pontine structures 
involved in PS generation are mainly located in the ventral portion of the DRN 
and display a sustained tonic discharge during SWS and PS, although a reduc¬ 
tion in discharge rate is seen during PS. Taken together, these findings do not 
support the view that the cessation of activity of serotonergic DRN neurons is 
critical for PS generation. Recent studies using pharmacological or genetic ma¬ 
nipulation of the 5-HT systems indicate that several 5-HT receptor subtypes, 
such as 5-HT,, 5-HT 2 and 5-HT 7 receptors, are involved in the inhibitory effect 
of 5-HT on PS generation [78-80], However, the mechanisms underlying this 
inhibitory effect remain to be determined. Clearly, much remains to be learned 
about which 5-HT neuron groups play a critical role in the control of PS gen¬ 
eration and their sites of actions. Finally, it should be mentioned that seroto¬ 
nergic DRN neurons receive excitatory inputs from Orx/Hcrt neurons that play 
an important role in the pathogenesis of cataplexy/narcolepsy, and that narco- 
lepsy-like PS episodes are caused by application of 8-OH-DPAT or muscimol 
to the DRN. The serotonergic system itself has been shown to play a role in 
the control of cataplexy/narcolepsy [81]. An understanding of the mechanisms 
underlying the narcolepsy-like PS episodes seen in cases of dysfunction of the 
serotonergic system or after inactivation of serotonergic DRN neurons will be 
an important subject for future studies. 


Serotonergic DRN neurons and PGO wave generation 

PGO waves are induced, even during W, either by reserpine, which depletes 
both catecholamines and 5-HT, or by para-chlorophenylalanine (PCPA), which 
decreases brain 5-HT. PGO waves induced by reserpine or PCPA are suppressed 
by the 5-HT precursor, 5-hydroxytryptophan (5-HTP). In addition, lesions of 
the raphe nuclei produce PGO waves even during W, leading to the general 
hypothesis that 5-HT inhibits the generation of PGO waves [66-68], McGinty 
and colleagues [28, 29] were the first to describe a specific relationship between 
DRN unit activity and PGO waves, and proposed that serotonergic DRN neu¬ 
ronal activity might inhibit PGO wave generation. According to our recent 
studies [11], the activity of about half of presumed serotonergic DRN neurons, 
in particular types I-A and II-A, displays a significant relationship with the oc¬ 
currence of PGO waves. As described above, the reduced level of spontaneous 
firing of presumed serotonergic DRN neurons during sleep is caused by disfa- 
cilitation due to the functional removal of tonic noradrenergic or histaminergic 
inputs to these neurons. Noradrenergic and histaminergic neurons themselves 
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cease firing prior to the occurrence of PGO waves [65, 82], and iontophoreti- 
cally applied HA, NE, or epinephrine (E) increases the spontaneous tonic dis¬ 
charge of PGO-on neurons and changes the firing pattern from phasic (burst) 
to tonic (repetitive) during sleep [74], 8-OH-DPAT has no effect on PGO wave 
generation when applied by microdialysis to any part of the DRN, while mus¬ 
cimol can induce PGO waves during W, especially when applied to the most 
rostral portion of the DRN near the oculomotor nucleus [11], A previous le¬ 
sion experiment also showed that PGO waves can be induced during W after 
lesioning of the most rostral part of the DRN, including the adjacent oculomo¬ 
tor nucleus [72], These data suggest that induction of PGO waves outside sleep 
might be due, at least in part, to dysfunction of the oculomotor system and that 
the cessation of activity of serotonergic DRN neurons may not be a necessary 
prerequisite for PGO wave generation. PGO-on neurons located in the cholin¬ 
ergic mesopontine tegmentum are insensitive to 5-HT, and systemic or micro¬ 
dialysis application of 5-HT or 5-HT agonists to the mesopontine tegmentum 
has no effect on PGO wave generation [76, 83], Moreover, PGO waves elicited 
by PCPA are not suppressed by local injection of 5-HTP into any region of the 
mesopontine tegmentum, but are immediately blocked when 5-HTP is injected 
into the ventrolateral medulla, which contains NE, E, and 5-HT neurons [84], 
These observations suggest that the critical site of action of 5-HT for PGO 
wave generation is in the ventrolateral medulla. 


Serotonergic neurons and muscle tone 

Both spinal cord and trigeminal motoneurons are markedly inhibited dur¬ 
ing PS as a result of postsynaptic inhibition [35, 85, 86], However, recent 
data suggest that not all motoneurons within the brainstem are postsynapti- 
cally inhibited during PS and that the suppression of discharge of hypoglos¬ 
sal motoneurons during PS may be caused by the withdrawal of a facilitatory 
serotonergic drive [87, 88], Medullary 5-HT neurons and a subgroup of DRN 
neurons innervate all cranial motoneurons and spinal cord. It therefore seems 
likely that a tonic disfacilitatory process similar to that seen in hypoglossal 
motoneurons may be operative for all spinal and cranial motoneurons. Pre¬ 
vious studies also demonstrated a prolonged hyperpolarization of the spinal 
and trigeminal motoneuron membrane during PS in conjunction with PGO 
bursts [36, 89], Because the incomplete type of serotonergic medullary neu¬ 
rons displays a phasic reduction or cessation of activity in conjunction with 
PGO/REM bursts, a phasic serotonergic disfacilitatory process might also be 
operating during these phasic events of PS. Further investigations on the role 
of medullary 5-HT neurons in the control of muscle tone are of considerable 
interest because of the potential involvement in cataplexy and in behavioral 
and respiratory disorders seen during sleep, such as REM behavior disorder 
and obstructive sleep apnea. 
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Role of 5-HT in the regulation of sleep and wakefulness 

Together with ascending NE, HA and Orx/Hcrt neurons, ascending serotoner¬ 
gic DRN neurons are generally regarded as waking neurons. The fact that the 
serotonergic DRN neurons receive convergent excitatory inputs from NE, HA, 
and Orx/Hcrt arousal systems appears to support this assumption [43], How¬ 
ever, it should be emphasized that, although neocortical and thalamo-corti- 
cal neurons are clearly activated by the actions of neurotransmitters, including 
ACh, NE, HA, and Glu, from the brain stem and hypothalamus, the role of 
5-HT in both ascending activation of thalamo-cortical networks and behav¬ 
ioral arousal remains unclear. Electrophysiological studies have demonstrated 
that 5-HT inhibits thalamo-cortical neurons [90, 91] and excites GABAergic 
neurons in the thalamic reticular nucleus [92] and local GABAergic neurons in 
the thalamus and cerebral cortex [90, 93], suggesting that 5-HT may play a role 
as a sleep-promoting neurotransmitter by directly inhibiting thalamo-cortical 
neurons and exciting GABAergic intemeurons in the cortex and the thalamus, 
thereby reducing global cortical activity. These data further suggest that EEG 
synchronization, a cerebral manifestation of sleep, is caused not only by deac¬ 
tivation of EEG activating systems, but also by direct inhibition of the cere¬ 
bral cortex by 5-HT, supporting the active hypothesis of sleep. Mesopontine 
cholinergic neurons, which play an important role in the initiation and main¬ 
tenance of EEG desynchronization and behavioral arousal, are strongly inhib¬ 
ited by 5-HT in in vitro intracellular and in vivo extracellular studies in the rat 
brain [14, 94, 95], although, in the cat brain, 5-HT appears to have only a weak 
state-dependent inhibitory effect on a population of presumed mesopontine 
cholinergic neurons [74], A potent hyperpolarizing effect of 5-HT on cholin¬ 
ergic basal forebrain neurons has also been reported [96], When microinjected 
into the cholinergic basal forebrain in conscious rats, 5-HT decreases y-EEG 
activity without significantly affecting SWS [97], whereas it induces drowsiness 
and high voltage slow cortical waves when injected into the POA of waking 
animals [98], Recent studies further revealed an inhibitory action of 5-HT on 
Orx/Hcrt neurons [99, 100], All these results are in favor of a role of serotonin 
in the induction of sleep, thereby supporting the 5-HT hypothesis of sleep, as 
previously proposed by Jouvet [66], 

In agreement with data from early lesion studies [66, 71, 72], suppression of the 
activity of serotonergic DRN neurons by local application of 8-OH-DPAT or 
muscimol in the cat results in a dose-dependent increase in W and a decrease 
in SWS without affecting PS generation, although PS episodes occur, as in nar¬ 
colepsy [73], These behavioral responses might be due to a reduction in extra¬ 
cellular 5-HT levels in forebrain structures, which receive massive projections 
of serotonergic DRN neurons, since, in anesthetized rats, applied 8-OH-DPAT 
induces a significant reduction in 5-HT output in serotonergic projection areas, 
such as the striatum and hippocampus [101-103], The 8-OH-DPAH-induced 
suppression of SWS appear to be largely ascribed to a reduction in extracellu¬ 
lar 5-HT levels in the hypothalamus, as PCPA-induced insomnia is specifically 
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reversed by intrahypothalamic injection of 5-HTP [84, 104, 105], Typical sero¬ 
tonergic DRN neurons exhibiting a regular pattern of tonic discharge during 
W may play a role in setting the level of 5-HT in forebrain target structures. 

As suggested by several authors [66, 97, 104, 106], serotonergic DRN neu¬ 
rons might play a role in the generation of SWS by influencing hypothalamic 
and/or basal forebrain structures, which contain both waking-specific and 
sleep-specific neurons [107], In contrast to typical serotonergic DRN neurons, 
a subgroup of serotonergic DRN neurons sending axons to the forebrain (type 
II-B) exhibit their highest rate of tonic discharge during SWS, with suppression 
of discharge during both W and PS. These SWS-active DRN neurons are locali¬ 
zed in the rostrodorsal portion of the DRN. However, the forebrain target sites 
of these sleep-active neurons remain to be determined. Further detailed studies 
are required to establish the exact role of these sleep-active DRN neurons in 
the control of sleep and wakefulness. 
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Abstract 

Extracellular electrophysiological recordings in freely moving cats have shown that seroto¬ 
nergic neurons from the dorsal raphe nucleus are tonically active during waking, decrease 
their activity during slow-wave sleep, and are nearly quiescent during paradoxical sleep. 
However, the mechanisms at the origin of the modulation of activity of these neurons were 
not identified. To fill this gap, we developed a method allowing extracellular single-unit 
recordings of neurons, combined with iontophoresis of agonists and antagonists in the 
head-restrained rat. Using this method, we were able to show that GABA is responsible 
for the decrease of activity of the dorsal raphe serotonergic cells both during slow-wave 
sleep and paradoxical sleep. In addition, combining retrograde tracing with cholera toxin 
B subunit and GAD immunohistochemistry, we showed that the GABAergic innervation 
of the dorsal raphe nucleus arises from multiple distant sources and not only from local 
interneurons as classically accepted. Among these afferents, we propose that GABAergic 
neurons located in the lateral and ventrolateral preoptic area and the pontine ventral peri¬ 
aqueductal gray are responsible for the reduction of activity of the serotonergic neurons 
of the dorsal raphe nucleus during slow-wave sleep and paradoxical sleep, respectively. 


Introduction 

In the mammalian central nervous system (CNS), the majority of the seroto¬ 
nergic neurons are found within the dorsal raphe nuclei (DRN) [1]. By means 
of their widespread projections throughout the entire brain, these serotonergic 
neurons are thought to play crucial roles in a great variety of physiological and 
behavioral functions including sleep and wakefulness (W) [2, 3], Accordingly, 
extracellular electrophysiological recordings in freely moving rats and cats have 
shown that DRN serotonergic neurons fire tonically during W, decrease their 
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activity during slow-wave sleep (SWS), and are nearly quiescent during para¬ 
doxical sleep (PS) (PS-off cells) [4, 5], It has been proposed that the spontane¬ 
ous tonic firing of DRN neurons during W, which is close to that observed in 
anesthetized rats [6], is mainly due to their intrinsic pacemaker properties, as 
revealed by intracellular recordings in slices [7], 

The mechanisms responsible for the decrease of activity of the serotonergic 
neurons during SWS are not well known. However, the classical view is that 
the GABA transmission is increased during SWS, as supported by the strong 
hypnotic properties of the benzodiazepines acting on the GABA a receptors 
(reviews in [8, 9]). However, Nitz and Siegel [10, 11] found an increase of the 
amount in GABA in the cat’s locus coeruleus (LC) but not the DRN during 
SWS compared to W. In contrast, Levine and Jacobs [12] showed that ion- 
tophoretic application of bicuculline on DRN serotonergic neurons reversed 
the typical suppression of activity seen during SWS. A GABA inhibition was 
therefore likely be responsible for the decrease of activity of serotonergic neu¬ 
rons during SWS. 

The cessation of firing of these neurons during PS, according to the classi¬ 
cal “reciprocal interactions” models [13] is the result of active PS-specific in¬ 
hibitory processes, originating from the pontine neurons responsible for the PS 
onset and maintenance (PS-on cells). These neurons were first thought to be 
cholinergic and localized in the dorsal pons (laterodorsal tegmental, peduncu- 
lopontine and peri-LCa nuclei). However, it has subsequently been suggested 
that they might use GABA or glycine rather than acetylcholine as an inhibi¬ 
tory neurotransmitter [14, 15], Indeed, it has been reported that acetylcholine 
is only weakly inhibitory on serotonergic DRN neurons [16], In contrast, in 
anesthetized rats, iontophoretic application of GABA strongly inhibits DRN 
neurons and co-iontophoresis of bicuculline, a GABA a antagonist, antag¬ 
onizes this effect [17, 18], Furthermore, in vitro studies on slices using focal 
stimulation and bath-applied bicuculline revealed that GABA mediated inhibi¬ 
tory postsynaptic potentials (IPSPs) in DRN cells [19], Recently, a substantial 
increase of GABA release has been reported in the DRN during PS compared 
to SWS [10], In agreement with these results, GABA-immunoreactive varicose 
fibers and GABA a receptors have been found in the rat DRN [20], The only 
negative evidence has been provided by Levine and Jacobs [12], who reported 
that application of bicuculline on DRN serotonergic cells during PS induces 
no effect. 

In conclusion, excepting this last result, a number of arguments suggest that 
GABA might be responsible for the inhibition of serotonergic neurons dur¬ 
ing SWS and PS. To further test this hypothesis: (1) we applied bicuculline, a 
GABA a antagonist on DRN serotonergic cells during SWS, PS and W using a 
method which allows extracellular single-unit recordings of neurons, combined 
with iontophoresis in the head-restrained awake rat [21], and (2) we localized 
in rats the GABAergic neurons potentially responsible for the inhibition of 
the serotonergic neurons of the DRN, combining injections of the retrograde 
tracer cholera-toxin B subunit (CTb) in the DRN and immunohistochemistry 
of GAD (GABA enzyme of synthesis). 
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Effect of the application of GABA antagonists on the activity 
of the rat DRN neurons during sleep 


As previously described [21, 22], 10 days before the first recording session, 
Sprague-Dawley rats were anesthetized with pentobarbital and placed in a ste¬ 
reotaxic frame. Three stainless steel screws were fixed on the bone and three 
steel electrodes inserted into the neck muscles to monitor the EEG and EMG, 
respectively. A U-shaped piece of steel with four screws at each angle was bolted 
to a special restraining frame (designed by ourself in collaboration with GFG 
Co, Pierre-Benite, France); this was itself fastened to the stereotaxic apparatus 
with dummy ear-bars. The U was centered above the DRN, the screws and the 
connector for EEG and EMG were then embedded in dental cement. During 
daily repetitive trials of increasing duration, the rat was comfortably supported 
by a hammock within the stereotaxic frame with its head painlessly secured to 
the restraining device. 

Using extracellular recordings, DRN neurons were identified on line by their 
characteristic waveform discharge rate correlated with the sleep-waking cycle. 
To combine DRN single-unit recordings with microiontophoresis, a seven-bar¬ 
rel micropipette glued alongside a glass recording micropipette was used, as 
described previously [23], The barrels were filled with GABA, bicuculline or 
saline. The recording pipette was filled with 2% Pontamine Sky Blue (PSB) in 
0.5 M sodium acetate solution. Recording pipette signals were amplified, dis¬ 
played and discriminated with conventional electronics. 


Spontaneous activity of DRN neurons during 
the sleep-waking cycle 


Recording sessions were conducted in the afternoon during the normal sleep 
period. The rats showed long periods of quiet W and SWS, and brief PS ep¬ 
isodes (lasting less than 2-3 min). Quiet W was mostly observed during the 
first days of the experiments, progressively replaced by SWS, indicating a more 
complete habituation of the rats. Spectral analysis of the EEG during each 
vigilance stage revealed frequency band activities similar to those described in 
freely moving rats [24], 

The database for the present study consists of 85 DRN neurons recorded 
during at least two of the vigilance stages. Usually, neurons were recorded for 
4-30 min and were lost during large movements associated with periods of ac¬ 
tive W. Serotonergic DRN neurons were identified by their typical broad action 
potentials (1.5-2 ms duration) and a spontaneous discharge rate correlated to 
the sleep-waking cycle and subsequent localization in the DRN by the PSB de¬ 
posit. Their mean discharge rate (± SEM) was of 1.56±0.12 Hz during quiet W. 
During SWS, DRN cells showed a decrease in their firing rate (0.57±0.06 Hz), 
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while during PS episodes they were nearly quiescent (0.06±0.02 Hz), showing 
only occasional single spikes. 


Iontophoretic applications of bicuculline 

Iontophoretic ejections of bicuculline during W, SWS and PS (60-100 nA, 
22-94 s) induced a progressive and sustained increase of the discharge rate of 
DRN neurons without inducing a change in the vigilance state. The firing fre¬ 
quency increased from 1,56±0.12 Hz to 4.44±0.29 Hz (mean ± SEM) during W 
and from 0.57±0.06 Hz to 4.14±0.29 Hz during SWS. During PS, while DRN 
neurons were silent (0.06±0.02 Hz), they also showed following bicuculline ap¬ 
plication a marked increase of their firing rate to 4.22±0.36 Hz. An analysis of 
variance for repeated measures, with pre- and post-drug as one factor and vigi¬ 
lance state as another factor, revealed that the absolute increase in discharge 
rate was not statistically different among the vigilance states. However, for some 
neurons, the rat displayed successive short periods of SWS and W during the 
effect of bicuculline. We compared their discharge rate during two successive 
SWS and W periods in these neurons. We found that their increase of activity 
was not statistically different between W and SWS periods [25], 

Iontophoretic applications of GABA suppressed the spontaneous discharge 
of DRN neurons during W or SWS. During these vigilance states, GABA-in- 
duced inhibitions were fully antagonized by bicuculline co-iontophoresis. 


Pharmacological and physiological significances 

We found that iontophoretic application, during PS or SWS, of bicuculline, a 
specific GABA a receptor antagonist, restores a tonic firing in the DRN sero¬ 
tonergic neurons. In addition, we observed that application of bicuculline dur¬ 
ing W induces a sustained increase of the discharge rate. These results seem to 
indicate the existence of a tonic GABAergic input to the DRN present during 
all vigilance state. Such effect might be due to nonspecific excitatory effects of 
bicuculline. However, this is unlikely since the application of gabazine, another 
GABA a receptor antagonist, induces the same effect as bicuculline (Fig. 1). 
Taken together, these results suggest that, as for many different types of CNS 
neurons, the DRN serotonergic cells are tonically inhibited by GABA. 

Further, we found that during the effect of bicuculline, the discharge rate 
of a DRN neuron no longer changed at the transitions between W and SWS 
and between PS and W. These results strongly suggest that GABA release is 
responsible for the inactivation of DRN serotonergic neurons during SWS and 
PS. Partly in agreement with our results, Nitz and Siegel [10], using the micro¬ 
dialysis technique, found an increase of the GABA release in the cat DRN dur- 
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Fig. 1 Effects of an iontophoretic application of gabazine (50 nA, 36 s) during PS. Note 
the strong increase in the discharge rate of the DRN neuron induced by the gabazine 
injection. The application of 80H-DPAT (50 nA, 4 s), a 5-HT 1A agonist induced a cessa¬ 
tion of discharge of the neuron confirming its serotonergic nature 


ing PS as compared to SWS and W values. Based on these and our results, we 
therefore suggest that during W, the DRN cells are under a tonic GABAergic 
inhibition, which increases during SWS as well as PS, and is therefore respon¬ 
sible for the inactivation of these neurons during these states. 

It remains to be determined whether the tonic GABAergic inhibitions re¬ 
vealed in this study are post- and/or presynaptic. Indeed, the activation of 
DRN cells seen after bicuculline might be due not only to a removal of post- 
synaptic GABA input, but also to that of GABAergic presynaptic inhibition 
of excitatory inputs to DRN cells. Such presynaptic inhibition of excitatory 
terminals has been well documented for many neurons in the CNS [26], and is 
therefore likely to occur in DRN serotonergic neurons. 


Origin of the GABAergic projections to the DRN 

Afferent projections to the DRN 

We confirmed that the lateral habenula contains a large number of retrogradely 
labeled cells by following CTb injections in the DRN [25, 27], In addition, we 
observed a large number of retrogradely labeled cells in the orbital, cingulate, 
infralimbic, dorsal peduncular, and insular cortices [28], A moderate to sub¬ 
stantial number of retrogradely labeled cells was also visible in the ventral 
pallidum and a small to substantial number in the claustrum. In addition, we 
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observed a large number of retrogradely labeled cells in the lateral, ventral and 
medial parts of the bed nucleus of the stria terminalis, the medial and lateral 
preoptic areas, the medial preoptic nucleus, the lateral, dorsal and posterior 
hypothalamic areas and the perifomical nucleus [28], A substantial number of 
retrogradely labeled cells were also seen in the zona incerta and a moderate 
number in the subincertal nucleus. We further saw a substantial to large num¬ 
ber of retrogradely labeled cells in the tuber cinereum, the medial tuberal nu¬ 
cleus. We also observed a moderate number of CTb + cells in the ventromedial 
hypothalamic area and the arcuate nucleus. Occasional retrogradely labeled 
cells were seen in the tuberomammillary nucleus. A moderate number of retro¬ 
gradely labeled cells were distributed in the central nucleus of the amygdala. 
A large number of neurons were found in the ventral part of the periaqueducal 
gray, just above the oculomotor nuclei, and more caudally in the ventrolateral, 
lateral and dorsal parts of the periaqueductal gray. At the same level, the deep 
mesencephalic and oral pontine reticular nuclei contained numerous CTb + cells. 
At the pontine level, the largest number of CTb + cells was seen in the lateral 
parabrachial nucleus. The median parabrachial nucleus, the lateral tegmental 
nucleus of Castaldi and the Barrington’s nucleus contained a moderate number 
of CTb + cells. A small number of neurons were found in the raphe magnus, 
parvocellular reticular, the gigantocellular alpha nuclei, the lateral and dorsal 
paragigantocellular reticular nuclei and the nucleus of the solitary tract [29], 


Origin of the GABAergic input to the DRN 

Neurons immunoreactive to GAD and serotonin in the DRN 

After double immunostaining of GAD and serotonin on the same section, 
GAD-immunoreactive cell bodies were observed in the lateral part of the DRN 
mixed with serotonergic neurons. In contrast, the medial part of the DRN con¬ 
tained a large number of serotonin cells and only a few GAD-positive neurons 
(unpublished results). Double-labeled cells were not observed. These results fit 
well with the findings of Stamp and Semba [30], 


GABAergic neurons projecting to the DRN 

Following CTb injections restricted to the DRN, the largest number of retro¬ 
gradely labeled cells immunoreactive to GAD (CTb + /GAD + cells) was found in 
the lateral hypothalamic area [25], A substantial number of double-labeled cells 
was also observed in the lateral preoptic area, the posterior hypothalamic area, 
the substantia nigra reticular part, the ventral tegmental area, the ventral pon¬ 
tine periaqueductal gray including the DRN itself and the rostral oral pontine 


GABAergic inhibition of serotonergic neurons during sleep 


243 


reticular nucleus. A moderate number of double-labeled cells were seen in the 
ventral pallidum, the medial preoptic nucleus, the lateral parabrachial nucleus 
and the dorsal paragigantocellular nucleus (DPGi). Finally, a small number of 
CTb + /GAD + neurons were seen in the magnocellular preoptic nucleus, para¬ 
ventricular hypothalamic nucleus, the lateral habenula, the tuberomammillary 
nucleus and the raphe magnus and gigantocellular alpha nuclei. 

Our results indicate that the DRN receive GABAergic inputs from neurons 
located in a large number of distant regions from the forebrain to the medulla 
[25], We observed a small number of GAD + neurons retrogradely labeled inside 
the DRN. These results indicate that the GABAergic innervation of the DRN 
arise from multiple GABAergic groups. Such results contrast with the classi¬ 
cal concept of GABA as an intemeuron neurotransmitter and suggest that the 
5-HT neurons of the DRN neurons might be inhibited by multiple populations 
of GABAergic neurons located in different structures, raising the question of 
the functional role of such complexity. One possibility is that these GABAergic 
afferents are destined only in part to the 5-HT neurons of the DRN. This seems 
likely since the DRN is an heterogeneous structure. Another possibility is that 
some of these afferents are postsynaptic and others presynaptic; however, the 
more likely explanation is that each of these afferents is active only under spe¬ 
cific physiological conditions. 

Based on physiological and electrophysiological data (see above), we expect 
that one or several of these GABAergic afferents are turned on specifically dur¬ 
ing SWS and others during PS, and are responsible for the progressive decrease 
of activity of serotonergic neurons during these sleep states. 


GABAergic input inhibiting DRN serotonergic 
neurons during SWS 


The most likely candidate for the inhibition of the serotonergic neurons dur¬ 
ing SWS is the lateral and ventrolateral preoptic area. Indeed, lesion of this 
structure in cats and rats induces an insomnia [31-35], while its stimulation 
induced SWS [36], Neurons increasing their activity specifically during SWS 
have been recorded in this area [37^10]. Moreover, C-Fos-positive cells were 
observed only in the lateral and ventrolateral preoptic area after long periods 
of SWS, and it has been further shown that these neurons are in part GABA 
and galanin positive and project to the serotonergic neurons of the DRN and 
the wake active histaminergic neurons from the tuberommamillary nucleus and 
noradrenergic neurons of the LC [25, 41-44], From these and our results, we 
can therefore propose that GABAergic neurons in the lateral and ventrolateral 
preoptic area increase their firing just before the onset and during SWS and via 
their inhibitory projections to wake-inducing structures, including the DRN, 
induce SWS. 
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GABAergic input inhibiting DRN serotonergic 
neurons during PS 


Brainstem 

Double-staining experiments combining GAD and CTb immunostaining 
showed that the DRN receive GABAergic inputs from neurons located in a large 
number of distant regions from the forebrain to the medulla (see above) [25, 
45], Based on physiological and electrophysiological data (see above), we expect 
that one or several of these GABAergic afferents are “switched on” specifically 
at the onset of and during PS episodes and are responsible for the inhibition 
of DRN serotonergic neurons during PS. It is very likely that these neurons are 
located in the brainstem. Indeed, PS-like episodes still occur in pontine or de¬ 
cerebrate cats [2], Moreover, PS episodes induced by carbachol injections in the 
pons of decerebrate animals are still associated with a cessation of activity of 
serotonergic neurons of the raphe obscurus and pallidus nuclei [46], A number 
of results suggest that the ventral periaqueductal gray (vlPAG) and to a minor 
extent the DPGi contain the GABAergic neurons responsible for the inhibi¬ 
tion of DRN serotonergic neurons during PS [25, 45], Indeed, focal iontopho- 
retic applications of NMDA in the vlPAG induce bicuculline-sensitive IPSPs in 
DRN serotonergic neurons [47], Further, Yamuy et al. [48] showed that after a 
long period of PS induced by a pontine injection of carbachol, a large number 
of Fos-positive cells are visible in the DRN and the vlPAG. Moreover, Maloney 
et al. [49] observed in the PAG an increase in Fos-positive GAD-immunoreac- 
tive neurons after a PS rebound induced by deprivation. It is therefore likely that 
the GABAergic neurons inhibiting the serotonergic neurons of the DRN are 
mainly localized in the vlPAG. In contrast, GABAergic neurons of the DPGi 
seem to be mainly responsible for the inhibition of LC noradrenergic neurons. 
Indeed, local applications of bicuculline block the DPGi-evoked inhibition of 
LC neurons [50], Further, in rats with a CTb injection into the LC, we observed 
a large number of CTb and Fos double-immunostained neurons in the DPGi 
and a substantial number in the vlPAG and the lateral paragigantocellular re¬ 
ticular nucleus (LPGi) specifically after PS rebound [51], From these results, 
we propose that the GABAergic neurons responsible for the inhibition of the 
LC noradrenergic neurons during PS are mainly, but not exclusively, located in 
the DPGi. To further test this hypothesis, we recorded the spontaneous activ¬ 
ity of neurons from the DPGi across the sleep-waking cycle in head-restrained 
rats. Neurons with an activity specific to PS (PS-on neurons) were found within 
this nucleus [52], supporting the idea that it contains the GABAergic neurons 
responsible for the cessation of activity of the noradrenergic neurons of the 
LC during PS. This hypothesis is also supported by a recent study showing that 
electrical stimulation of the area of the DPGi induces an increase in PS quanti¬ 
ties [53], It is, however, likely that the GABAergic neurons inhibiting the sero¬ 
tonergic neurons of the DRN are mainly localized in the vlPAG rather than the 
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DPGi since the latter structure provides only a small GABAergic projection to 
the DRN [25], It should be finally added here that we recently proposed that the 
vlPAG and DPGi GABAergic neurons could also inhibit during PS the PS-off 
GABAergic neurons from the deep mesencephalic reticular nucleus (DPMe) 
[54], If this hypothesis is correct, the onset of firing of vlPAG and DPGi GA¬ 
BAergic PS-on neurons constitutes the triggering event in the induction of PS. 
The mechanisms responsible for the activation of these neurons remain to be 
identified. It can nevertheless be proposed that it can be due to their intrinsic 
properties and/or inputs from structures regulating the homeostasis of PS like 
the posterior hypothalamus (see below). 


Hypothalamus 

We found two substantial GABAergic projections to the DRN from the hypo¬ 
thalamus. They arise from the lateral preoptic area and the lateral hypothalamic 
area. Besides, it was found that galanin neurons located in the extended ventro¬ 
lateral preoptic nucleus are Fos-positive after PS increases [55], Further, a small 
number of these Fos-labeled neurons project to the DRN [55], The functional 
role of these projections is unclear since PS-like episodes still occur in pontine 
or decerebrate cats [2], Moreover, PS episodes induced by carbachol injections 
in the pons of decerebrate animals are still associated with a cessation of acti¬ 
vity of serotonergic neurons of the raphe obscurus and pallidus nuclei [46], It is 
however possible that, in normal conditions, the hypothalamic projections par¬ 
ticipate in the inactivation of DRN serotonergic neurons. They might be also 
involved in PS homeostasis via their projection to DRN serotonergic neurons 
and other PS-inhibitory systems, such as the noradrenergic neurons from the 
LC or the GABAergic neurons from the DPMe. 

In support of this hypothesis, we found evidence that the posterior and lat¬ 
eral hypothalamic areas play a role in PS regulation. First, despite the fact that 
a PS-like state still occurred in “pontine cats”, indicating that the brainstem 
as sufficient to produce PS, PS recovery following PS deprivation was abol¬ 
ished in these animals [56], These results suggest that the brainstem contains 
the structures responsible for PS but not those responsible for its homeostatic 
regulation. Moreover, neurons specifically active during PS were recorded in 
the perifomical hypothalamic area (PH) [57-59], Further, PS quantities were 
decreased after muscimol injection in the PH [32, 60], 

Further supporting a role of the posterior and lateral hypothalamus in PS 
regulation, we recently demonstrated that it contains a very large number of 
Fos-labeled neurons specifically in rats perfused after a PS rebound compared 
to those perfused at the end of the PS deprivation [61]. We further demonstrated 
that the majority of these neurons are immunoreactive to melanin-concentrat¬ 
ing hormone (MCH). These results suggest that MCH neurons are specifically 
and strongly active during PS. Our data are in agreement with electrophysio- 
logical studies showing the presence in the PH of neurons strongly active dur- 
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ing PS [57-59], To determine whether MCH plays a role in PS regulation, we 
performed intracerebroventricular administrations of MCH. Injections of 0.2, 
1 and 5 pg induced a dose-dependant increase in PS quantities compared to 
saline, due to an increase in the number of PS bouts, but not of their duration. 
To a minor extent, an increase in the amount of SWS was also observed after 
MCH administration. 

Since MCH neurons co-contain GABA, are active during PS and because 
MCH is rather an inhibitory peptide [62], MCH neurons likely promote PS 
indirectly by inhibiting neurons, themselves inhibiting the PS executive neurons 
during W and SWS. The serotonergic neurons of the DRN, the noradrenergic 
neurons of the LC, the histaminergic neurons in the tuberomammillary nu¬ 
cleus and the hypocretin (Hcrt) neurons all belong to this category and are 
innervated by MCH neurons [63-65], They are active during W, decrease or 
nearly cease their activity during SWS, and are silent during PS [22, 25, 59, 66, 
67], Further, based on electron and light microscopic observations, it has been 
shown that MCH and Hcrt neurons are interconnected [68, 69] (Fig. 1). We 
therefore propose that MCH neurons primarily induce SWS and PS via com¬ 
bined MCH/GABAergic inhibitory actions on the intermingled Hcrt neurons 
and to a minor extent on the monoaminergic neurons, including DRN seroto¬ 
nergic neurons. They could also increase PS quantities via a direct inhibitory 
projection on the DPMe PS-off GABAergic neurons [70, 71]. Since PS still oc¬ 
curs in “pontine cats”, it is unlikely that MCH and Hrct neurons are necessary 
to induce PS as stated above. We therefore proposed that they could be rather 
responsible for PS homeostasis since PS rebound is abolished in “pontine cats”. 
Additional studies are, however, needed to explore this hypothesis. 
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Abstract 

Serotonergic neurons are spontaneously active with slow regular discharge during alert 
behavior and decreased activity during sleep. Sleep-related inhibition of serotonergic 
neurons is mediated by GABAergic inputs that originate in hypothalamic and brainstem 
sleep centers. During alert behavior, tonic release of GABA contributes to feedback and 
feedforward inhibitory circuits that, together with serotonin autoreceptors, prevent excess 
stimulation of serotonergic neurons. Glutamatergic inputs to the raphe originate in the 
brainstem, several hypothalamic nuclei and cerebral cortex. Although glutamate receptor 
agonists strongly stimulate serotonergic neuronal discharge, the physiological significance 
of glutamatergic inputs is not well established. In the dorsal raphe nucleus (DRN), more 
glutamatergic fibers terminate on GABAergic than serotonergic neurons. Moreover, GABA 
normally restrains the excitatory influence of glutamatergic inputs to serotonergic neurons 
in the DRN. Peptidergic neurons modulate the activity of GABAergic and glutamatergic 
interneurons that synapse with serotonergic neurons in the DRN. These neuropeptides, 
for example CRF, endogenous opioids and Substance P, are implicated in responses to 
environmental challenges. Thus, stress can indirectly influence the activity of serotonergic 
neurons. In the raphe, GABAergic and glutamatergic intemeurons may serve as a final 
common pathway for integrating information about environmental challenges and inputs 
from hypothalamic and brainstem centers that control the usual sleep-related inhibition of 
serotonergic neurons. Neuropeptides might thereby promote alert behavior to appropri¬ 
ately cope with stress. However, persistent peptidergic-induced changes in the strength of 
GABAergic and glutamatergic inputs to serotonergic neurons could contribute to insom¬ 
nia, anxiety and major psychiatric disorders such as depression and schizophrenia. 
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Introduction 

Serotonergic neurons in the mammalian brain are influenced by inhibitory 
and excitatory amino acid (EAA) neurotransmitters. Studies published in the 
1970s demonstrated the inhibitory effect of GABA on serotonergic cell bodies 
in the raphe nuclei [1] and the excitatory influence of EAA receptor agonists 
[2], However, many details of the anatomy and physiology of GABAergic and 
EAA, presumably glutamatergic inputs remain unclear. Topics addressed in 
this chapter include the physiological roles of GABA and glutamate in control¬ 
ling changes in serotonergic neuronal discharge and serotonin (5-HT) release 
and the possibility that dysfunctional regulation of serotonergic neurons by 
GABA and glutamate contributes to disorders such as insomnia, depression, 
and schizophrenia. This chapter begins with a short overview of the signifi¬ 
cance of GABA and glutamate influences on serotonergic neurons, followed 
by a discussion of the methodological pitfalls that contribute to limitations in 
interpreting the literature summarized in the remainder of this chapter. Details 
of our methods and results are available in research reports and a previous 
review article [3-7], 

More is known about the physiological significance of inhibitory com¬ 
pared to excitatory inputs to serotonergic neurons. GABA usually acts as an 
inhibitory neurotransmitter in the adult mammalian brain and it contributes 
to decreases in activity of serotonergic neurons during the transition from alert 
behavior to sleep [8], In particular, projections from the hypothalamus to the 
raphe nuclei are implicated in the GABA-mediated decrease in activity of sero¬ 
tonergic neurons during non-REM sleep [9], Although not all reports agree, the 
near total suppression of serotonergic neuronal discharge during REM sleep 
may depend on increased activity of a different population of GABAergic neu¬ 
rons in the brainstem [9], On the other hand, GABA also dampens serotoner¬ 
gic neuronal activity during alert, active behavior [9], Thus, along with 5-HT 
autoreceptors, GABAergic neurons may play a role in restraining serotonergic 
neuronal discharge, thereby preventing excessive release of 5-HT in response 
to excitatory influences. Moreover, several neuropeptides inhibit GABAergic 
inputs to serotonergic neurons, particularly in the dorsal raphe nucleus (DRN) 
and the surrounding periaqueductal gray (PAG). These neuropeptides might 
thus disinhibit serotonergic neurons. This could contribute to pathologies such 
as insomnia, anxiety and depression. 

The physiological significance of EAA inputs to the raphe is not well 
established. Administration of glutamate receptor agonists into the raphe 
strongly excites serotonergic neurons [8, 10], However, the increase in activity 
of serotonergic neurons during the transition from sleep to alert behavior does 
not depend on release of endogenous glutamate in the raphe. EAA receptor 
antagonists do block the stimulatory influence of phasic sensory stimuli [8], 
Compared to most other neuronal populations, serotonergic neurons are slow 
firing even during active behavior, and phasic sensory-evoked, glutamate- 
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dependent effects on serotonergic neuronal activity are usually modest. The 
typical pattern is a small transient increase in the probability of an action 
potential after a sensory stimulus followed by a longer period of decreased 
probability of discharge, perhaps as a consequence of 5-HT autoreceptor 
activation or GABA-mediated feedback inhibition of serotonergic neurons 
[11], Glutamate may also be involved in positive feedback circuitry whereby 
increased release of 5-HT in several forebrain sites activates glutamatergic 
neurons that in turn stimulate serotonergic neurons in the DRN [12], However, 
glutamatergic projections from the forebrain to the raphe also synapse with 
GABAergic neurons that inhibit serotonergic neurons [13-15], In summary, 
as reviewed in detail below, GABA-mediated inhibitory tone is dominant at 
least in the DRN of laboratory animals during undisturbed alert behavior. 
Nevertheless, positive feedback loops could play a role in sustaining activity 
of serotonergic neurons and stabilize the alert state. Moreover, this positive 
feedback pathway, specifically involving excessive activation of 5-HT 2 receptors 
on glutamatergic neurons might contribute to symptoms of schizophrenia such 
as hallucinations [16]. 

The possibility that disturbances in GABA and glutamate neurotransmis¬ 
sion are involved in psychiatric disorders provides a compelling reason for 
understanding the inputs that control serotonergic neurons. Indeed, several 
recent review articles have summarized the evidence that GABA and gluta¬ 
mate, perhaps via aberrant control of monoaminergic neurons, are involved 
in schizophrenia and depression [17, 18]. Presumably, multiple factors interact 
to cause psychiatric disorders with indirect evidence implicating 5-HT along 
with dopamine and norepinephrine. Because psychiatric disorders are as¬ 
sociated with profound disturbances in cognition and emotions, many studies 
have focused on the postsynaptic effects of monoamine neurotransmitters in 
cerebral cortex and interconnected forebrain sites such as amygdala. However, 
symptoms of psychiatric disorders also include changes in physiological 
functions including sleep and hormone release that are controlled from lower 
centers such as the brainstem and hypothalamus. Thus, it is reasonable to sus¬ 
pect that disturbances in presynaptic influences on monoamine neurons, and 
thus widespread changes in transmitter release, could contribute to symptoms. 
Relevant to this issue, administration of the noncompetitive A-methyl-D-as- 
partate (NMDA) receptor antagonist ketamine to patients in remission from 
schizophrenia elicits symptoms of psychosis [19], while the same compound 
rapidly alleviated symptoms in patients suffering from major depression [20], 
Moreover, noncompetitive NMDA receptor blockers administered to labora¬ 
tory animals increased extracellular levels of dopamine and 5-HT [6, 21, 22], 
These glutamate receptor antagonists, perhaps by blocking excitatory inputs 
to GABAergic neurons, might disinhibit monoaminergic neurons. Together 
these studies support the hypothesis that disturbances in glutamatergic and 
GABAergic control of serotonergic neurons contribute to symptoms of major 
psychiatric disorders. 
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Methodological issues 

The hypotheses summarized above are based largely on studies of non-pri- 
mate mammals that used electrophysiological recording along with anatomical, 
pharmacological and neurochemical methods to study the inputs influencing 
serotonergic neurons in the raphe nuclei. Many anatomical and physiological 
features of the mammalian raphe are similar in rodents, cats and primates [23], 
Nevertheless, studies using different species have disagreed concerning the role 
of GABA and glutamate inputs to serotonergic neurons. Notably, in contrast 
to the conclusions based on single unit recording in the cat DRN, data from 
rats suggest that GABA mediates the suppression of serotonergic neuronal dis¬ 
charge during REM sleep [9], Also at variance with cat data, endogenously re¬ 
leased GABA in the DRN of alert rats restrains serotonergic neuronal activity 
[4, 9, 24], Anatomical studies of the primate raphe provide further evidence of 
species differences. For example, the location of the majority of serotonergic 
cell bodies differs in the rat and primate raphe (see discussion in [25]). More¬ 
over, there are few if any functional studies of the inputs to serotonergic neu¬ 
rons in the primate raphe. Thus, it is difficult to ascertain which if any species 
is an appropriate animal model for understanding the physiological role of glu¬ 
tamate and GABA inputs in the human raphe. Because control of serotonergic 
synaptic transmission is important in regulating arousal state and presumably 
a factor in several major psychiatric disorders, obtaining additional data from 
primates is important. 

The midbrain DRN and median raphe nucleus (MRN) are the location of 
serotonergic cell bodies with axons that project to the forebrain. Serotonergic 
innervation of forebrain modulates cognitive and emotional aspects of the 
alert behavioral state [23], In contrast, the caudal, medullary raphe nuclei con¬ 
tain serotonergic cell bodies with projections to other brainstem sites and spi¬ 
nal cord. In these sites 5-HT modulates physiological processes such as muscle 
tone and respiration that also change across the sleep wake cycle [26, 27], The 
DRN provides the majority of projections to higher centers, and most reports 
concerning presynaptic control have focused on the DRN with fewer studies 
of MRN and little evidence concerning presynaptic control of the medullary 
raphe nuclei. Thus, the focus of this review is on the DRN together with com¬ 
parisons to the MRN. 


Anatomical methods 

Glutamatergic and GABAergic inputs to serotonergic neurons originate in 
many forebrain and brainstem sites [9,28], A number of different neuropeptides 
are also present in cell bodies and terminals in the raphe and surrounding areas 
of the brainstem. These include CRF, substance P, neurotensin, hypocretin and 
various endogenous opioids. Motivated by interest in control of arousal and 
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adaptation to stress, a few reports have used immunocytochemistry combined 
with light or electron microscopy (EM) to describe the synaptic connections be¬ 
tween peptidergic, aminergic and serotonergic neurons [29, 30], This evidence 
together with results of electrophysiological and neurochemical approaches 
suggest that some neuropeptides via synaptic connections with GABAergic and 
glutamatergic neurons indirectly influence serotonergic neurons in the DRN. 
Moreover, several morphologically distinct groups of 5-HT-containing neu¬ 
rons are present in the DRN with recent evidence suggesting that aminergic 
and peptidergic neurons differentially innervate these subpopulations [31-33], 
Because of the presence of subgroups of serotonergic neurons, a fuller picture 
of raphe synaptic circuitry will require additional studies combining anatomi¬ 
cal methods and other approaches. However, although immunocytochemistry 
combined with EM is a powerful method for defining synaptic circuitry, few 
groups are engaged in this approach. 


Electrophysiological methods 

Electrophysiological recording of presumed 5-HT-containing neurons in brain 
slices and anesthetized animals provided evidence that GABA and glutamate 
influence neuronal activity in the raphe. Early studies identified serotonergic 
neurons by electrophysiological and pharmacological criteria including slow 
regular discharge, broad action potentials and suppression of discharge by 
5-HT, receptor agonists. Combining intracellular recording with immunocyto¬ 
chemistry, Vandermaelen and Aghajanian [34] confirmed that these neurons 
contain 5-HT, although recent studies indicate that some of neurons in the 
DRN that fit these criteria are negative for 5-HT immunoreactivity and may 
instead contain dopamine [25, 35, 36], Moreover, although many raphe neu¬ 
rons are slowly and regularly firing, there is accumulating evidence of a diverse 
population of serotonergic neurons including some that discharge at higher 
rates in phase with repetitive movements such as locomotion and breathing 
[26], Also, some 5-HT-immunopositive neurons discharge slowly and regularly 
but in doublet or triplet bursts rather than single spikes, with another subpop¬ 
ulation that discharges at higher rates in synchrony with hippocampal theta 
rhythm [37-39], Thus, the pitfalls of single-unit studies include the possibility 
that subpopulations of 5-HT-containing neurons are missed and conversely, 
that some neurons could be misidentified as containing 5-HT. 

The differing results of single-unit recording and neurochemical methods 
for studying the effects of antidepressant and opioid drugs on 5-HT exem¬ 
plify the problems in interpretation of electrophysiological data. Single-unit 
recording studies indicate that acute administration of a 5-HT reuptake inhibi¬ 
tor (SSRIs) produces a nearly complete suppression of serotonergic neuronal 
discharge. These observations supported the hypothesis that an SSRI-induced 
increase in 5-HT efflux in the raphe activates somatodendritic autoreceptors, 
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and this prevents increased efflux of 5-HT in forebrain sites [40], In contrast, 
neurochemical data indicate that SSRIs immediately elevate extracellular levels 
of 5-HT in forebrain sites, and this increase can be reversed by autoreceptor 
agonists [41, 42], Thus, the neurochemical evidence suggests that SSRIs elicit 
increased 5-HT efflux in projection sites that is dependent on serotonergic neu¬ 
ronal discharge. Explanations for these disparate observations include the pos¬ 
sibility that single-unit studies missed a population of serotonergic neurons 
that are not strongly inhibited by SSRIs, since one of the criteria for identifying 
5-HT containing neurons is suppression of activity by autoreceptor agonists. 
Another possible explanation is that occasional discharge of individual seroto¬ 
nergic neurons could sustain increased 5-HT efflux in forebrain when clearance 
is strongly inhibited. 

Single-unit recording and neurochemical studies also provided contrasting 
evidence concerning the effects of opioids on serotonin. Morphine had no ef¬ 
fect on discharge rate of serotonergic neurons recorded in vivo [43], However, 
neurochemical methods provided evidence that morphine and more selective 
p-opioids increase 5-HT efflux in the DRN and its forebrain projections sites 
[44-46], This discrepancy may be related to the observation from in vitro re¬ 
cording that p-opioids inhibit both GABAergic and glutamatergic inputs to 
serotonergic neurons in the DRN [14], Thus, the net effect of morphine might 
depend on the relative strengths of GABA and glutamatergic excitation of sero¬ 
tonergic neurons. When GABA tone is dominant, then the net effect would be 
disinhibitory with increased release of 5-HT. Whatever the explanation, these 
discrepancies indicate that results of single-unit recording studies alone are not 
always sufficient in elucidating the effects of endogenous and exogenously ad¬ 
ministered substances. 

Experiments using anesthetized animals and in vitro approaches have pro¬ 
vided evidence concerning local circuitry along with information concerning 
receptor pharmacology and transduction mechanisms in the raphe. However, 
determining the behavioral roles of projections to the raphe depends on studies 
in unanesthetized animals, and single-unit recording have provided key insights 
into the role of GABA and glutamate in controlling state-related changes in 
discharge of serotonergic neurons. Thus, using unanesthetized but head-re- 
strained cats, Levine and Jacobs recorded serotonergic neurons during local 
application of receptor ligands into the DRN and provided evidence of the role 
of glutamatergic and GABAergic inputs in controlling changes in serotonergic 
neuronal activity across the sleep wake cycle [8], Compared to neurochemical 
methods, single-unit recording has the advantage of great temporal and spa¬ 
tial resolution. However, the approach is difficult and only a few subsequent 
electrophysiological studies in behaving animals have addressed the role of glu¬ 
tamate and GABA in the raphe. In brief, as discussed in detail below, studies 
in other species have provided evidence that confirms some but not all of the 
conclusions based on the initial report using cats. 
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Neurochemical methods 

Extracellular 5-HT can be measured by microdialysis or voltammetry, and 
levels generally co-vary with changes in neuronal activity [47-50], Based on 
the effects of drugs such as 8-OH-DPAT and tetrodotoxin, extracellular 5-HT 
measured both in the raphe and in forebrain sites depends on depolarization- 
induced release [51]. In the raphe, 5-HT is released from dendrites and axon 
collaterals of serotonergic neurons. Presumably, this is mainly dependent on 
action potential-induced exocytosis (see review by Tao and Auerbach [6]), al¬ 
though one recent study indicates that NMDA receptor agonists directly evoke 
calcium-induced 5-HT release from dendrites [52], Another exception to the 
general conclusion that 5-HT efflux in the raphe correlates with serotonergic 
neuronal activity is important to mention. Local infusion of a 5-HT reuptake 
inhibitor into the raphe, by blocking clearance, elicits increases in extracellular 
5-HT in the raphe. This in turn activates autoreceptors and thus, local infu¬ 
sion of a reuptake blocker at higher concentrations into the raphe indirectly 
inhibits serotonergic neuronal discharge and causes decreased 5-HT release in 
forebrain sites [51, 53], In contrast, local infusion of a ligand that stimulates 
neuronal discharge (e.g., an EAA receptor agonist) produces parallel increases 
in extracellular 5-HT in the raphe and forebrain projection sites [3, 5], The dif¬ 
ference in this case is that, while autoreceptors are stimulated and restrain the 
effect, the increase in raphe extracellular 5-HT is linked to an increase in sero¬ 
tonergic neuronal discharge. In summary, extracellular 5-HT in both the raphe 
and forebrain reflects changes in serotonergic neuronal activity in response to 
glutamate receptor ligands that directly stimulate discharge. Similarly, direct in¬ 
hibitors of discharge such as GABA a receptor agonists elicit parallel decreases 
in extracellular 5-HT in the raphe and forebrain projection sites. 

It is important to note the distinction between the terms extracellular level, 
efflux, and release of a neurotransmitter. “Extracellular level” refers to the 
amount of a neurotransmitter in extracellular space and is the quantity directly 
measured by neurochemical techniques such as in vivo voltammetry and micro¬ 
dialysis. Efflux refers to neurotransmitter that escapes into extracellular space. 
The rate of efflux is determined by the difference between the rate of release 
and the rate of clearance by reuptake and metabolism. In contrast, release re¬ 
fers only to the amount of neurotransmitter transported from inside to outside 
of nerve cells normally by exocytosis. Extracellular levels and efflux generally 
co-vary and these terms are often used interchangeably. However, extracellu¬ 
lar levels and efflux do not always reflect changes in release. For example, sys¬ 
temic administration of an SSRI usually produces increases in efflux and thus 
elevated extracellular levels of 5-HT despite autoreceptor activation and the 
resultant decreases in serotonergic neuronal discharge and exocytosis of 5-HT 
[54], In summary, release, efflux and extracellular levels of 5-HT usually change 
in parallel but some experimental manipulations, notably reuptake blocker ad¬ 
ministration, cause a decrease in release, while efflux and extracellular levels of 
5-HT increase. 
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Advantages of microdialysis include its relative ease and thus, the large num¬ 
ber of experiments that can be completed. Disadvantages include relatively poor 
spatial and temporal resolution. Thus, microdialysis measures release from a 
relatively large area and cannot be readily used to test for differential regulation 
of subpopulations of serotonergic neurons. Also, microdialysis requires sample 
collection for 10-30 min to obtain sufficient 5-HT for detection by generally 
available analytical methods. Because of these factors, in vivo microdialysis is 
better suited to evaluating sustained tonic influences of endogenous glutamate 
and GABA, while electrophysiology is better at detecting rapid phasic effects. 
In contrast to microdialysis, in vivo voltammetry has good temporal and spatial 
resolution but has not been used as frequently because of greater technical dif¬ 
ficulties. In summary, the complexity of the anatomy and possibility of distinct 
subgroups of serotonergic neurons present daunting challenges to understand¬ 
ing the role of GABAergic and glutamatergic inputs. The remainder of this 
chapter reviews the literature with a primary focus on GABA and glutamate in 
the DRN relevant to their role in control of sleep-wake state and implication 
in psychiatric disorders. 


GABA in the raphe 

GABA-containing neurons and terminals in the raphe 

GABA-containing neurons and terminals are present in the raphe [25, 55, 
56], Some GABAergic neurons may project out of the raphe to forebrain sites 
including the hypothalamus [57], However, the relatively small size of most 
GABAergic neurons suggests that these are mainly interneurons, an inference 
supported by anatomical evidence of numerous GABA terminals contacting 
serotonergic neurons in the DRN [58], GABA-immunoreactive neurons have 
also been demonstrated in brainstem sites adjacent to the raphe, and physiolog¬ 
ical evidence confirms that some of these synapse with serotonergic neurons [9, 
13,14], Lastly, retrograde tracing studies combined with immunocytochemistry 
provide evidence that several forebrain sites provide GABAergic projections to 
the raphe. These include GABA-containing cells in several hypothalamic nuclei, 
notably the lateral hypothalamic and preoptic areas, and several basal ganglia 
structures [9], Retrograde tracing also provides evidence of GABAergic projec¬ 
tions to the DRN from the lateral habenula (LHB) [9], This is consistent with 
an early report that stimulation in the LHB inhibited the discharge of seroto¬ 
nergic neurons, an effect blocked by the GABA receptor antagonist picrotoxin 
[59]. However, glutamatergic fibers may be more prominent in this habenular 
pathway and contact GABAergic intemeurons in the DRN to indirectly inhibit 
serotonergic neurons [24, 60], Further complicating this picture is evidence that 
a glutamatergic projection from the LHB can also directly stimulate serotoner¬ 
gic neurons [24, 60], In summary, GABAergic projections to the raphe originate 
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in several forebrain and brainstem sites along with numerous small GABAergic 
neurons in the raphe that synapse with serotonergic neurons. 


Physiology, neurochemistry and pharmacology 

Studies using a variety of approaches provide evidence of the inhibitory in¬ 
fluence of GABA on serotonergic neurons. For example, local application of 
GABA receptor agonists into the DRN inhibited the discharge of serotonergic 
neuron [1], GABA receptor agonists in the DRN and the MRN also reduced 
5-FIT efflux and metabolism in the forebrain [61-64], Spontaneous inhibitory 
postsynaptic events [potentials (IPSPs) and currents (IPSCs)] can be recorded 
from serotonergic neurons in brain slices. Focal application of NMDA at vari¬ 
ous sites within the DRN and surrounding PAG greatly enhanced the rate of 
IPSCs recorded in serotonergic neurons. Tetrodotoxin blocked this effect con¬ 
sistent with the conclusion that activation of glutamate receptors stimulates 
the discharge of GABAergic neurons that innervate serotonergic neurons [14], 
Bicuculline, a selective GABA a receptor antagonist, also greatly reduced IP¬ 
SCs, indicating that GABA a receptors were mainly responsible for inhibitory 
synaptic influences [14], Together these studies indicate that GABAergic neu¬ 
rons in the DRN and nearby brainstem sites inhibit serotonergic neurons via 
GABA a receptors. 

GABA a receptors are mainly responsible for mediating the influence of 
GABA in the midbrain raphe, while GABA„ receptors on nerve terminals 
inhibit 5-HT release in forebrain projection sites [4], Thus, infusion of the 
GABA A -selective agonist muscimol into the DRN and MRN decreased extra¬ 
cellular 5-HT to ~40% of baseline levels in these two midbrain sites of sero¬ 
tonergic cell bodies (Fig. la). In a dual-probe microdialysis experiment, mus¬ 
cimol infusion into the DRN elicited a decrease in extracellular to -60% of 
baseline levels in the nucleus accumbens, as determined by a second probe in 
this forebrain site (Fig. lb). Serotonergic neurons in the DRN project to the 
nucleus accumbens. Thus, this dual-probe experiment supports the conclusion 
that the muscimol-elicited reduction in extracellular 5-HT in the DRN reflects 
inhibition of serotonergic neuronal discharge and parallels decreased 5-HT re¬ 
lease in forebrain projection sites. Muscimol infusion into the MRN produced 
no significant change in 5-HT in the nucleus accumbens (Fig. lb). Serotoner¬ 
gic neurons in the MRN do not project to the nucleus accumbens. Thus, this 
observation indicates that diffusion of muscimol away from the dialysis probe 
was relatively limited. During local application of the GABA„-selective agonist 
baclofen into the DRN, extracellular 5-HT declined only slightly [4], However, 
baclofen acted in the cerebral cortex, striatum, and the nucleus accumbens to 
inhibit 5-HT efflux [4, 65, 66], In contrast, infusion of the GABA a receptor 
agonist muscimol into the nucleus accumbens had no significant effect on 5- 
HT efflux in this forebrain site [4], In summary, GABA inhibits serotonergic 
neuronal activity and release with its effect on serotonergic cell bodies mainly 
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Fig. 1 Effect of infusing a GABA a receptor agonist into the dorsal (DRN) or median 
(MRN) raphe nucleus. The horizontal bar indicates the period of muscimol administra¬ 
tion into the raphe. For this and subsequent figures, all drugs were administered local¬ 
ly by reverse microdialysis infusion, (a) Muscimol infusion into the DRN significantly 
reduced extracellular 5-HT in the DRN. Similarly, infusion of this GABA a receptor 
agonist into the MRN reduced 5-HT in the MRN. (b) In a dual-probe experiment, mu¬ 
scimol was infused into the DRN or MRN and a second probe was used to measure 
5-HT in the nucleus accumbens (NAC). Muscimol in the DRN induced a significant 
decrease in extracellular 5-HT in the NAC. Muscimol in the MRN had no effect on 5- 
HT in the NAC. For this and all other figures, results are 5-HT levels expressed as mean 
± s.e.m. percent change from the average pre-drug baseline level. Results were analyzed 
by ANOVA followed by Scheffe’s F test with significance level p<0.05. Asterisks indica¬ 
ting significant differences are omitted for the sake of clarity. Modified from, and with 
details provided in [4] 


mediated by GABA a receptors and its influence on serotonergic nerve termi¬ 
nals mediated by GABA b receptors. 

It is important to note that GABA b receptors in the DRN do influence sero¬ 
tonergic neurons. This is a complex effect involving in part, inhibition mediated 
by G protein-linked activation of potassium channels on serotonergic neurons 
[67], However, GABA b receptors also serve as autoreceptors on GABAergic 
terminals [68], By inhibiting GABA release, GABA„ receptors could have the 
opposite influence of disinhibiting serotonergic neurons. During local infusion 
of (i)-baclofen we observed only a small decrease in 5-HT efflux in the DRN. 
To test the hypothesis that this represented a balance between direct inhibition 
of serotonergic neuronal discharge and a disinhibitory influence of blocking 
GABA release, we pretreated with the GABA a receptor antagonist bicuculline. 
With GABA a receptors in the DRN already blocked, the potential disinhibi¬ 
tory effect of baclofen is eliminated. As discussed below in more detail, we 
observed very large increases in 5-HT efflux in response to bicuculline influx 
into the DRN, indicative of strong tonic GABA a receptor-mediated inhibition 
of serotonergic neurons under our experimental conditions. Moreover, consis¬ 
tent with our hypothesis, the inhibitory effect of baclofen on 5-HT efflux in the 
DRN was greatly enhanced by pretreatment with bicuculline [4], In contrast 
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to our observation of a slight decrease in 5-HT efflux in response to infusion 
of (±)-baclofen alone, Abelian and co-workers [69] observed increases in sero¬ 
tonergic neuronal discharge and efflux in the DRN in response to infusion of 
(+)-baclofen. This suggests that the dominant effect of the active enantiomer, 
(+)-baclofen, is autoreceptor-mediated disinhibition of serotonergic neurons in 
the raphe. Nevertheless, taken together these results indicate that the net effect 
of GABA b receptor stimulation in the DRN depends on the balance between a 
direct but relatively weak inhibitory effect on serotonergic neuronal discharge 
and the disinhibitory influence of decreased GABA release. 

Endogenously released GABA inhibits serotonergic neurons during periods 
of wakefulness as well as sleep. In support of this conclusion, bicuculline infu¬ 
sion into the DRN evoked significant increases in 5-HT efflux in the forebrain 
of alert rats [4], The prolonged increase in extracellular 5-HT evoked by this 
GABA a receptor antagonist provides evidence that endogenous GABA media¬ 
tes tonic inhibition of serotonergic neurons in the DRN. Following up on this 
earlier study, we observed significant increases in 5-HT efflux in the DRN dur¬ 
ing reverse dialysis infusion of bicuculline into the DRN at concentrations too 
low to cause obvious changes in behavior [7], Higher concentrations of bicucul- 
line produced strikingly large, up to fourfold increases in extracellular 5-HT in 
the DRN (Fig. 2a) accompanied by significant increases in locomotor activity 
[4, 7], Similarly, during bicuculline infusion into the DRN, Fiske and co-work¬ 
ers [70] observed approximately threefold increases in extracellular 5-HT in the 
DRN accompanied by increases in waking and decreases in all sleep stages as 
monitored by EEG records. Infusion of other GABA a receptor antagonists, 
picrotoxin and GABAzine into the DRN also produced large increases in 5-HT 
efflux in the DRN [4, 7], Based on results of “dual-probe” experiments, our 
data suggest that this reflects increased activity of serotonergic neurons and 
thus, increased release of 5-HT in forebrain sites. Accordingly, during infusion 
of GABA a receptor antagonists into the DRN, extracellular 5-HT was also 
increased in the nucleus accumbens as determined by a second probe in this 
forebrain site [4], 

Infusion of GABA a receptor antagonists into the MRN, in contrast, pro¬ 
duced only slight increases in extracellular 5-HT (Fig. 2a). Thus, even at high 
concentrations, neither bicuculline nor picrotoxin infusion produced significant 
increases in 5-HT in the MRN [4], Also, in dual-probe experiments, infusion of 
these two antagonists into the MRN had no significant effect on 5-HT efflux 
in the forebrain [4], As stated above, infusion of the GABA a receptor agonist 
muscimol into the MRN produced large decreases in extracellular 5-HT in the 
MRN, similar to its effect in the DRN. Thus, GABA a receptors are present on 
serotonergic neurons in the MRN but are not activated tonically by endoge¬ 
nous GABA under our experimental conditions. Nevertheless, bicuculline infu¬ 
sion into the MRN did produce significant increases in locomotor activity [7], 
Presumably, GABA a receptors are present on non-serotonergic neurons that 
are activated in a tonic manner by endogenous GABA. Moreover, disinhibition 
of these non-serotonergic neurons has a stimulatory influence on locomotion 
that apparently does not depend on increased 5-HT release. 
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Fig. 2 Effect of infusing GABA a receptor antagonists into the DRN or MRN. (a) Infu¬ 
sion of the GABA a receptor antagonists, bicuculline (100 pM) or GABAzine (300 pM) 
into the DRN significantly increased extracellular 5-HT in the DRN. Bicuculline 
(100 pM) infusion into the MRN did not affect 5-HT in the MRN. (b) During forced 
treadmill locomotion at a moderate rate, 5-HT efflux in the DRN was significantly in¬ 
creased to ~50% above baseline. Bicuculline infusion (100 pM) into the DRN produced 
a large, approximately threefold increase in 5-HT in the DRN during a period when 
rats were already aroused by forced treadmill locomotion that began 30 min before and 
continued during the period of drug infusion. Modified from, and with details provided 
in [7] 


Because infusion of GABA a receptor antagonists into the DRN stimulated 
motor activity, the associated increase in 5-HT efflux might have been an indi¬ 
rect consequence of the changes in behavioral state (see [71, 72] for discussion). 
Thus, GABA receptor blocker infusion into the DRN, similar to the effect in 
the MRN, could activate non-serotonergic neurons that project to sites me¬ 
diating behavioral arousal [73], In turn, projections from brain sites involved 
in arousal might activate serotonergic neurons by long loop feedback. How¬ 
ever, dissociations between behavior and 5-HT suggest that arousal was not the 
primary cause of changes in 5-HT. First, bicuculline infusion into the MRN 
stimulated locomotor activity but did not evoke a significant increase in 5-HT. 
Secondly, we examined the interaction between the effects of forced treadmill 
locomotion and bicuculline infusion (Fig. 2b). In the DRN, 5-HT efflux in¬ 
creased only modestly, by -50% during forced locomotion, even with the tread¬ 
mill set to high speeds [7], This was far less than the approximately threefold 
effect of bicuculline on 5-HT efflux in the DRN. Moreover, when rats were 
put on the treadmill and forced to run starting 30 min before and continuing 
during drug infusion, bicuculline still increased 5-HT by approximately three¬ 
fold [7], This observation suggests that GABA a antagonist-evoked increases in 
5-HT efflux are not an indirect consequence of behavioral activation because 
rats were already strongly aroused before the start of bicuculline infusion. To¬ 
gether these results support the conclusion that changes in 5-HT efflux were 
not secondary to behavioral arousal but instead, resulted from local effects of 
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blocking GABA a receptors on serotonergic neurons. Lastly, it is worth point¬ 
ing out that, despite tonic activation of GABA a receptors in the DRN of alert 
rats, the ability of muscimol to strongly depress 5-HT efflux indicates that these 
receptors are not maximally stimulated. Thus, at the onset of sleep, increased 
release of GABA in the DRN could still strongly inhibit serotonergic neuro¬ 
nal activity. Moreover, different populations of GABA a receptors may mediate 
tonic inhibition and the strong depressant effect during sleep. This speculative 
suggestion is based on evidence of GABA function in other brain sites. For 
example, GABA a receptors in synaptic junctions mediate phasic inhibition in 
the cerebellum and hippocampus. In contrast, extrasynaptic GABA a receptors 
have a tonic inhibitory influence ([74], see also reviews by [75, 76]). 

The conclusion that endogenous GABA has a tonic inhibitory influence on 
serotonergic neurons is further supported by single-unit recording experiments 
in unanesthetized, head-restrained rats. Bicuculline was applied in the DRN 
during different vigilance states monitored by EEG and EMG electrodes. Ion¬ 
tophoresis of bicuculline during quiet waking behavior induced a more than 
twofold increase in discharge rate of serotonergic neurons without a measur¬ 
able change in state of arousal [9], In contrast, neurochemical and electrophysio- 
logical studies in cats found no evidence of tonic GABA inhibition of seroto¬ 
nergic neurons. Thus, infusion of a GABA a receptor blocker into the DRN 
of alert cats did not enhance 5-HT efflux in the forebrain [77], Similarly, in 
alert head-restrained cats, iontophoretic application of bicuculline in the DRN 
did not stimulate serotonergic neuronal discharge [8], Possibly, these results re¬ 
flect technical problems. For example, bicuculline application in amounts small 
enough to avoid strong behavioral activation might not block sufficient num¬ 
bers of GABA a receptors in the larger dendritic tree of serotonergic neurons in 
the cat DRN. In cats, bicuculline did prevent the decrease in discharge during 
non-REM sleep [8], However, this population of GABA a receptors might be 
restricted to serotonergic cell bodies or proximal dendrites with the population 
of GABA a receptors mediating tonic inhibition located distally. Alternatively, 
control of serotonergic neurons might be different in the DRN of rats and cats. 
Additional studies, in particular using primates, are needed to resolve this issue 
and to assess the relevance of tonic inhibition of serotonergic neurons to hu¬ 
man physiology and behavior. 

It is noteworthy that spontaneous IPSCs recorded from serotonergic cells in 
the MRN were greater in frequency and amplitude in the MRN compared to 
the DRN as measured in rat brain slices [78], In contrast, our in vivo measure¬ 
ments indicated much greater tonic inhibition of serotonergic neurons in the 
DRN [7], Many inputs to the raphe are severed during preparation of brain 
slices and this probably accounts for these conflicting observations. Together, 
the in vivo and in vitro results suggest that GABA-containing neurons in the 
MRN have greater spontaneous activity and little excitatory drive to these GA- 
BAergic neurons during waking behavior. In contrast, GABAergic neurons in 
the rat DRN are less active spontaneously and stimulated by afferents during 
waking behavior. 
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Physiological and behavioral significance 
of GABA in the raphe 


During sleep 

GABA mediates the declining activity of serotonergic neurons during non- 
REM sleep and also according to some reports, the suppression of discharge 
during REM sleep. In rats and cats, administration of bicuculline locally in the 
DRN during slow wave sleep (SWS) increased discharge of serotonergic neu¬ 
rons to the quiet waking rate [8,9], This strongly suggests that increased release 
of GABA via binding to GABA a receptors is primarily responsible for inhibit¬ 
ing serotonergic neuronal activity during non-REM sleep. Although microdia¬ 
lysis measurements in cat DRN did not detect increased GABA efflux during 
SWS, this might reflect limited sensitivity of the technique [79], Nitz and Siegel 
[79] did detect a significant increase in GABA efflux in cat DRN during REM 
sleep, consistent with electrophysiological evidence that the suppression of se¬ 
rotonergic neuronal discharge in rat DRN depends on increased activation of 
GABA receptors. Thus, bicuculline infusion during REM, similar to the ef¬ 
fect during SWS, increased serotonergic neuronal discharge to the quiet waking 
rate [9], Increased cFOS labeling of GABAergic neurons in the rat brainstem 
during REM rebound further supports the conclusion that GABA suppresses 
serotonergic neuronal activity during REM sleep [80], However, in contrast to 
rats, bicuculline iontophoresis in the DRN of cats did not activate serotonergic 
neuronal discharge during REM [8], This result was confirmed and extended 
with evidence that decreased facilitatory input from histaminergic and norad¬ 
renergic neurons during REM sleep contributes to decreased serotonergic neu¬ 
ronal discharge in the cat DRN [81], Possibly, these conflicting observations 
reflect species differences. 


During alert behavior 

There is little direct evidence concerning the significance of tonic GABA-medi¬ 
ated inhibition of serotonergic neurons in the rat DRN during periods of wak¬ 
ing behavior. The absence of GABA tone on serotonergic neurons in the MRN 
suggests a profound difference in regulation but provides no insight into the 
behavioral significance of this observation. GABAergic neurons play a number 
of different roles in other brain sites. With respect to brain circuitry, general 
functions include disinhibition, with decreased release of GABA permissive to 
discharge of target neurons. GABAergic neurons are also implicated in feed¬ 
back and feedforward inhibition in the CNS. Indirect evidence supports the 
conclusion that GABA functions in each of these ways to control the activity 
of serotonergic neurons during wakefulness. 
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It is important to note that the inference of “tonic inhibition” of seroto¬ 
nergic neurons in the DRN is based on neurochemical measures with poor 
temporal resolution. Thus, averaged over long sample periods, microdialysis 
provides evidence of sustained inhibition but this does not preclude short-term 
fluctuations in the strength of this influence. In fact, single-unit recording data 
indicate that the discharge rate of some GABAergic neurons oscillates at a slow 
frequency. Neurons recorded in the raphe were marked by a juxtacellular la¬ 
beling method with neurochemical identity confirmed using ex vivo immunos- 
taining for glutamic acid decarboxylase (GAD) and tryptophan hydroxylase 
[56], Compared to serotonergic neurons, GABAergic neurons in the DRN had 
shorter action potentials and discharged at a much higher mean rate. The mean 
12-Hz discharge rate of these GAD-positive neurons typically oscillated at a 
frequency of 1-2 Hz [56], These oscillations are characteristic of the discharge 
rate of serotonergic neurons. Thus, Allers and Sharp [56] suggest that phasic 
reductions in GABA release disinhibit serotonergic neurons. Furthermore, 
based on morphological features, including highly branched dendritic trees 
and axons, Allers and Sharp suggest that these GABAergic neurons could in¬ 
tegrate widespread inputs and synchronize the activity of serotonergic neurons 
throughout the DRN. These inferences were based on recordings of a small 
number of neurons in the DRN of anesthetized rats, and it will be important 
to extend these observations to recordings in alert animals. Nevertheless, simi¬ 
lar to effects of GABA in cerebral cortex [82, 83], it is reasonable to surmise 
that phasic decreases in GABA release might have a disinhibitory influence and 
thereby promote rhythmic synchronization of serotonergic neurons in a specific 
frequency range. 

In addition to a disinhibitory function, some GABAergic inputs may play 
a feedback inhibitory role in the DRN. Both short and long negative-feedback 
loops have been postulated. For example, 5-HT 2 receptor agonists stimulated 
the frequency and amplitude of IPSCs recorded from serotonergic neurons in 
midbrain slices containing the DRN [84], The GABA a receptor antagonist bi- 
cuculline and the sodium channel blocker tetrodotoxin blocked 5-HT-elicited 
IPSC activity. The inference that 5-HT released in the raphe stimulates GABA¬ 
ergic intemeurons, which in turn inhibit serotonergic neurons is supported by 
additional in vitro and in vivo studies [52, 85], Similarly, there is evidence of 
long loop negative-feedback pathways from the forebrain to the raphe. Accord¬ 
ing to this hypothesis, 5-HT stimulates glutamatergic neurons in the prefrontal 
cortex (PFC) that project caudally and activate GABAergic interneurons in the 
brainstem to reduce serotonergic neuronal activity. In support of this hypothe¬ 
sis, intracortical administration of 5-HT receptor agonists or electrical stimula¬ 
tion in the PFC inhibits serotonergic neurons [86-90], Moreover, a tract tracing 
study provided evidence of monosynaptic projections from PFC making direct 
synaptic contact with GABAergic neurons in the DRN [13]. However, 5-HT 
receptor antagonists alone do not activate serotonergic neuronal discharge in 
anesthetized rats or 5-HT release in alert animals [91,92], This suggests that the 


266 


Sidney B. Auerbach 


postulated short and long feedback loops do not contribute to strong GABA 
tone observed under standard laboratory conditions. In conclusion, similar to 
the role of somatodendritic 5-HT 1A autoreceptors, GABA-mediated feedback 
inhibition may function only during periods of excessive release of 5-HT. 

GABAergic interneurons also may contribute to feedforward inhibition of 
serotonergic neurons. According to this hypothesis, an excitatory input stimu¬ 
lates serotonergic neurons and inhibitory interneurons that synapse with the 
same serotonergic neurons. Thus, the efficacy of direct monosynaptic excit¬ 
atory inputs would be restrained by GABA after a brief disynaptic delay. The 
LHB is one forebrain site implicated in feedforward inhibition of serotonergic 
neurons. The LHB in the diencephalon is caudal to the thalamus and provides 
a monosynaptic input to the DRN and MRN. However, according to reports 
using different methods, habenular stimulation can either inhibit [59] or excite 
serotonergic neurons [24], At higher stimulation intensities in the LHB, excita¬ 
tion switched to inhibition of serotonergic neurons, consistent with the feed¬ 
forward inhibitory circuit hypothesis [60], Accordingly, weaker stimulation in 
the LHB may preferentially activate a monosynaptic excitatory pathway with 
a disynaptic GABAergic pathway dominant during higher intensity stimula¬ 
tion of the LHB. In support of this hypothesis, focal application of NMDA 
excites both serotonergic neurons and GABAergic intemeurons that synapse 
with serotonergic neurons in the DRN [14], Moreover, as shown in Fig. 3 and 
discussed below in detail, endogenous glutamate in the DRN has only a weak 
stimulatory influence on 5-HT efflux, but this effect was greatly enhanced when 
GABA a receptors were first blocked by bicuculline infusion into the DRN [7], 
Conversely, the increase in extracellular 5-HT induced by bicuculline infusion 
into the DRN was significantly reduced by subsequent infusion of glutamate 
receptor blockers [7], Although other interpretations are possible (see below), 
this observation is consistent with the possibility that tonic activity of GABA¬ 
ergic neurons is driven by glutamatergic inputs. Together, these data support 
the conclusion that feedforward inhibition restrains direct glutamate-mediated 
excitation of serotonergic neurons in the raphe. 

In some brain sites GABAergic intemeurons restrain plasticity of glutama¬ 
tergic synapses. For example, feedforward inhibition limits long-term potentia¬ 
tion (LTP) at glutamatergic synapses in the amygdala, with evidence that do¬ 
pamine suppresses this influence of GABA. Thus, increased dopamine release 
during emotional behavior may enhance synaptic plasticity and memory forma¬ 
tion [93, 94], In this context, it is interesting to note that GABAergic intemeu¬ 
rons in the DRN are inhibited by p-opioids [14], It is tempting to speculate that 
endogenous opioids released during stress might have a disinhibitory influence 
on serotonergic neurons. This could facilitate and promote persistent enhance¬ 
ment of glutamatergic synapses in the DRN. Consistent with this supposition, 
endogenous opioid influences on serotonergic neurons in the DRN contributed 
to stress-related maladaptive behaviors in a rat model of depression [95], Con¬ 
ceivably, persistent changes in synaptic strength in the raphe might play a role 
in human disorders such as insomnia, anxiety and depression. 
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Fig. 3 Interaction between glutamate and GABA receptor antagonists, (a) Combined 
infusion of AP-5 (1 mM), + DNQX (0.3 mM) into the DRN induced a small but signi¬ 
ficant decrease in extracellular 5-HT in the DRN. Separate infusion of AP-5 or DNQX 
into the DRN did not significantly affect 5-HT. (b) Bicuculline (100 pM) was infused 
into the DRN beginning 3 h before and continuing through a subsequent 2-h period 
of combined infusion of AP-5 (1 mM) + DNQX (0.3 mM) into the DRN. Note that 
the effect of blocking GABA a receptors on 5-HT is significantly reduced in response to 
infusing the ionotropic glutamate receptors. Nevertheless, with GABA a and glutamate 
receptors blocked, extracellular 5-HT remains elevated by ~50% above the original base¬ 
line level. Also, note that blocking GABA a receptors greatly enhanced the decrease in 5- 
HT produced by blocking glutamate receptors. The bar graph (c) shows that the percent 
decrease induced by AP-5 + DNQX was ~20% (calculated from data shown in Fig. 3a), 
but during blockade of GABA a receptors, the decrease was ~50% from baseline levels 
before infusion of the glutamate receptor antagonists (calculated from data shown in 
Fig. 3b). (d) AP-5 (1 mM) + DNQX (0.3 mM) were infused into the DRN beginning 2 h 
before and continuing through a subsequent 1-h period of bicuculline (100 pM) infusion 
into the DRN. Note, that compared to bicuculline alone, the maximum effect was signi¬ 
ficantly reduced when glutamate receptors were also blocked. However, irrespective of 
the order of administration, during combined blockade of GABA a and ionotropic glut¬ 
amate receptors, extracellular 5-HT was increased to ~50% above the original baseline 
level in the DRN. Modified from, and with details provided in [7] 
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Excitatory amino acids in the raphe 

Glutamate-containing neurons and terminals in the raphe 

Glutamatergic inputs to the DRN and MRN originate in the various nearby 
brainstem sites, several hypothalamic nuclei and the cerebral cortex [28, 96], 
Consistent with these anatomical studies, patch clamp recording in midbrain 
slices demonstrated glutamatergic neurons in the lateral DRN and adjacent 
PAG that project to serotonergic neurons [14]. However, at least in the DRN, the 
majority of glutamatergic terminals synapse on non-serotonergic neurons [97], 
Evidence of a strong monosynaptic glutamatergic projection from the LHB 
to serotonergic neurons in the DRN [24, 98] has been disputed [28], Instead, 
the majority of monosynaptic projections from the LHB may be GABAergic 
[28, 99, 100] with glutamatergic inputs from the LHB activating GABAergic 
interneurons in the DRN [60], Similarly, the PLC is a major source of glutama¬ 
tergic projections to the DRN but most synapse with GABAergic rather than 
serotonergic neurons [13, 90], Projections to the caudal raphe nuclei originate 
in the hypothalamus, amygdala, cerebral cortex and several brainstem areas 
[101]. Although the neurochemical identity of these fibers was not determined 
in this tract tracing study, electrophysiological recordings provide evidence of 
glutamatergic inputs to serotonergic neurons in the caudal raphe obscuris and 
pallidus [102], In summary, some glutamatergic inputs synapse with seroto¬ 
nergic neurons, but the observation of more numerous glutamatergic synapses 
with GABAergic neurons suggests that excitatory influences in the raphe are 
restrained by feedforward inhibition. 


Physiology, neurochemistry and pharmacology 

Both AMPA/kainate and NMDA receptors mediate excitatory effects of gluta¬ 
mate on serotonergic neurons. Lor example, focal glutamate application stim¬ 
ulated serotonergic neuronal discharge in the DRN of rats and cats [8, 10], 
with excitatory postsynaptic potentials fully blocked only by a combination of 
NMDA and non-NMDA receptor antagonists [103], Similarly, administration 
of EAA receptor agonists into the raphe evoked parallel increases in 5-HT ef¬ 
flux in the raphe and forebrain projection sites as determined by dual-probe 
microdialysis [3, 5], Lor example, kainate infusion into the DRN stimulated 
5-HT efflux in the DRN and nucleus accumbens, a forebrain site preferentially 
innervated by serotonergic projections from the DRN (Lig. 4). Also, kainate 
in the MRN stimulated 5-HT efflux in the MRN and dorsal hippocampus, a 
forebrain site preferentially innervated by serotonergic projections from the 
MRN. Together, these results suggest that EAA receptor agonists in the raphe 
stimulate serotonergic neuronal discharge and thereby evoke 5-HT release in 
forebrain sites. 
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Fig. 4 Effect of infusing kainate into the DRN. (a) Kainate (10-100 pM) infusion into 
the DRN induced significant increases in extracellular 5-HT in the DRN. The AMPA/ 
kainate receptor antagonist DNQX (10 pM) abolished the effect of kainate (10 pM) on 
5-HT in the DRN. In a dual-probe experiment, kainate (100 pM) infusion into the DRN 
induced a significant increase in extracellular 5-HT in the NAC. (b) In another dual-pro¬ 
be experiment, tetrodotoxin (TTX) infusion into the DRN produced parallel decreases 
in extracellular 5-HT in the DRN and NAC. TTX abolished the increase in 5-HT in the 
NAC elicited by kainate (100 pM) infusion into the DRN. In contrast, TTX attenuated 
but did not completely prevent the kainate (100 pM)-induced increase in 5-HT in the 
DRN. Modified from, and with details provided in [5] 


Kainate-evoked 5-HT efflux is probably mediated by AMPA-preferring 
glutamate receptors. Kainate binds to both kainate and AMPA receptors and 
thereby has widespread excitatory effects in the brain [104], However, neurons 
in the DRN express mRNA for AMPA- but not kainate-preferring receptor 
subunits [105], Moreover, kainate rapidly desensitizes recombinant receptors 
consisting of kainate-preferring subunits [106] but produces a robust, non-de¬ 
sensitizing response at AMPA receptors (reviewed in [107]). Thus, the sustained 
effect of kainate suggests that AMPA-preferring receptors mediated the evoked 
increase in 5-HT efflux. In contrast to kainate, AMPA in the DRN did not 
elicit a significant increase in 5-HT (Fig. 5). AMPA has little effect on kain¬ 
ate-preferring subunits and evokes rapidly desensitizing responses at recombi¬ 
nant receptors consisting of AMPA-preferring subunits [108, 109], Moreover, 
AMPAkines such as diazoxide attenuate desensitization of AMPA- but not 
kainate-evoked responses [108, 109], and, as shown in Fig. 5, combined infu¬ 
sion of diazoxide and AMPA produced a sustained elevation in 5-HT efflux [5], 
In summary, the sustained kainite-induced stimulation of 5-HT efflux together 
with the very small response to AMPA that was enhanced by an AMPAkine 
support the conclusion that AMPA-preferring receptors mediated these effects 
in the DRN. 

Baseline and kainate-evoked efflux of 5-HT depend largely on depolariza¬ 
tion-induced release. For example, tetrodotoxin infusion into the DRN reduced 
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5-HT in the DRN and a DRN projection site to -30% of baseline levels [5], 
Because tetrodotoxin inhibits action potential propagation, this supports the 
conclusion that extracellular 5-HT in the raphe and forebrain mainly reflects 
serotonergic neuronal discharge and action potential-elicited exocytosis. More¬ 
over, during tetrodotoxin infusion into the DRN, kainate-evoked increases in 
extracellular 5-HT were completely blocked in the nucleus accumbens (Fig. 4b). 
This further supports the conclusion that EAAs activate serotonergic neuro¬ 
nal discharge and thereby enhance 5-HT release in forebrain projection sites. 
However, similar to the effect on dopamine release [110], tetrodotoxin did not 
completely block kainate-evoked 5-HT efflux in the DRN (Fig. 4b). Thus, so¬ 
matodendritic 5-HT release evoked by kainate may be partly independent of 
action potentials. Consistent with this hypothesis, in response to EAA receptor 
agonists, calcium influx through NMDA receptors may directly evoke 5-HT 
release in the raphe [52], By activating autoreceptors and GABAergic inter¬ 
neurons (see above), this could play a role in feedback restraint of serotonergic 
neuronal discharge. 
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Fig. 5 Effect of infusing AMPA (300 gM) and the AMPAkine diazoxide (300 gM) into 
the DRN. AMPA infusion alone did not significantly increase 5-HT in the DRN. During 
diazoxide, AMPA infusion elicited an approximately 2.5-fold increase in extracellular 
5-HT in the DRN. Modified from, and with details provided in [5] 
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Kainate can cause excitotoxic degeneration [111], Thus, elevated 5-HT efflux 
may have resulted in part from kainate neurotoxicity. However, kainate was ef¬ 
fective when infused into the raphe at concentrations in the range of 10-30 |iM 
in the dialysis solution. The dialysis membrane is a barrier to free diffusion 
and the estimated amount of kainate reaching extracellular space, 0.1 pg, is 
below the level of toxicity [112], Furthermore, when kainate was infused into 
the DRN on two successive days, basal extracellular 5-HT in the DRN was 
unchanged and there was no attenuation of kainate-elicited increases in 5-HT 
efflux. Indeed, the effect of kainate appeared to be slightly but significantly 
enhanced on the second day [6], This observation and the presence of NMDA 
receptors in the DRN (see below) suggest that long-term potentiation of excita¬ 
tory synapses on serotonergic neurons is possible. 

Similar to kainate, NMDA stimulates serotonergic neurons and thereby 
enhances 5-HT efflux in forebrain projection sites [3], Compared to kainate, 
NMDA had lower potency in evoking 5-HT efflux. However, NMDA recep¬ 
tors are expressed in the PAG [105, 113] and NMDA-induced 5-HT efflux was 
completely blocked by competitive NMDA receptor antagonists [3], Infusing 
NMDA into the DRN increased 5-HT efflux in the nucleus accumbens. In con¬ 
trast, infusing NMDA into the MRN or through a dialysis probe 1 mm lateral 
to the border of the PAG had no effect on 5-HT efflux in the nucleus accum¬ 
bens. However, NMDA in the MRN did stimulate 5-HT efflux in the dorsal 
hippocampus, which, unlike the nucleus accumbens, is innervated by MRN 
serotonergic neurons [3], We cannot be certain that these observations reflect 
direct effects of NMDA on serotonergic neurons. For example, in rat midbrain 
slices, iontophoretic application of NMDA to interneurons in the PAG elicited 
excitatory postsynaptic currents in serotonergic neurons [14], Thus, enhanced 
5-HT efflux might at least in part result from NMDA-induced activation of 
glutamatergic neurons in the PAG that synapse with serotonergic neurons. De¬ 
pending on the location of the iontophoretic pipette in midbrain slices, NMDA 
also elicited inhibitory currents in serotonergic neurons [14], The possibility 
that NMDA also activates GABAergic neurons could explain the sustained 
decrease in raphe 5-HT after a short period of NMDA infusion lateral to the 
midbrain raphe [114], Direct stimulation of serotonergic neurons provides the 
simplest explanation for our observation that NMDA enhances 5-HT efflux. 
However, firm conclusions about the details of the local circuitry in the raphe 
will depend on further experiments using a combination of techniques. 

To determine if endogenous glutamate has a tonic influence on serotonergic 
neurons in the raphe, we infused EAA receptor antagonists [3, 5-7], Extracel¬ 
lular 5-HT was unchanged when selective glutamate receptor blockers were in¬ 
fused individually into the raphe. At concentrations that blocked the effects 
of EAA receptor agonists, separate infusion of selective NMDA and AMPA/ 
kainate receptor antagonists had no significant effect on 5-HT efflux (Fig. 3a). 
Based on electrophysiological evidence, antagonists of both NMDA and non- 
NMDA receptors may be necessary for fully blocking excitatory inputs to sero¬ 
tonergic neurons [103, 115], Consistent with this hypothesis, the non-selective 
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EAA receptor blocker kynurenate produced an -30% decrease in extracellular 
5-HT in the DRN [6], As shown in Fig. 3a, a similar decrease in DRN 5-HT 
was produced by combined infusion of AP-5 and DNQX, selective antagonists 
of NMDA and AMPA/kainate receptor, respectively [7], These observations 
suggest that endogenous glutamate has a tonic excitatory effect with stimula¬ 
tion of either AMPA or NMDA receptors alone capable of influencing sero¬ 
tonergic neuronal activity. However, serotonergic neurons are spontaneously 
active and results of single-unit recording in the DRN suggest that glutamate 
may be mainly important in mediating the weak excitatory influence of phasic 
sensory stimuli [8], Combined infusion of AP-5 and DNQX into the MRN 
induced an -60% decrease in extracellular 5-HT, significantly greater than the 
effect of blocking EAA receptors in the DRN [7], This provides evidence of 
tonic glutamate-mediated excitation of MRN serotonergic neurons, which may 
play a role in regulating hippocampal theta rhythms [116], 

The effect of glutamate receptor blockers in the DRN was significantly en¬ 
hanced by first blocking GABA a receptors [6, 7], Thus, combined infusion of 
AP-5 and DNQX decreased extracellular 5-HT by -20% from baseline levels 
(Fig. 3a, c). However, during bicuculline infusion, glutamate receptor antago¬ 
nists produced an -50% decrease from the elevated baseline induced by the 
GABA a receptor antagonist (Fig. 3b, c). This suggests that GABA inhibits the 
excitatory influence of glutamatergic neurons in the DRN. Moreover, the much 
greater tonic influence of glutamate on serotonergic neurons in the MRN might 
be explained by the low GABA tone in this site. Possibly, GABAergic neurons 
synapse with glutamatergic neurons, thus inhibiting excitatory inputs to seroto¬ 
nergic neurons in the DRN. Alternatively, GABA and glutamate might interact 
postsynaptically on serotonergic neurons. Accordingly, activation of GABA 
receptors on serotonergic neurons could offset the excitatory influence of glu¬ 
tamate by the process referred to as “shunting inhibition”. Related to this, the 
increase in 5-HT produced by infusing bicuculline into the DRN was attenu¬ 
ated by first blocking glutamate receptors (Fig. 3d). This suggests that much 
of the increase in 5-HT in response to blocking GABA a receptors depended 
on enhanced stimulation by glutamate. As indicated by the effect of infusing 
bicuculline before the glutamate receptor antagonists, GABA probably inhibits 
the influence of glutamatergic inputs to serotonergic neurons. However, this 
second result, the effect of blocking glutamate receptors before bicuculline in¬ 
fusion is also consistent with the possibility that the activity of GABAergic 
neurons depends partly on glutamatergic inputs. In support, glutamatergic pro¬ 
jections from the forebrain have an excitatory influence on GABAergic neu¬ 
rons in the DRN [24, 86], Nevertheless, it is important to note that irrespec¬ 
tive of the order of drug infusion, 5-HT efflux increased similarly when both 
GABA a and ionotropic glutamate receptors were blocked (Fig. 3b, d). Thus, 
compared to ionotropic glutamate receptors, GABA a receptors had a stronger 
tonic influence on serotonergic neurons in the rat DRN under our experimental 
conditions. Our methods cannot determine the exact synaptic circuitry inter¬ 
connecting GABAergic, glutamatergic and serotonergic neurons. Nevertheless, 
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consistent with other reports, these results suggest that both GABA and glu¬ 
tamate directly influence serotonergic neurons and the tonic activity of these 
inputs differs greatly in the DRN and MRN. 

Phencyclidine (PCP) and ketamine are non-competitive antagonists of 
NMDA that block the ion channel associated with these receptors. These drugs 
produce a behavioral syndrome in humans that resembles psychosis (reviewed 
by [117]) but rapid antidepressant effects have also been observed [20, 118]. 
Systemic administration of non-competitive NMDA receptor blockers to rats 
activates dopaminergic neurons and increases extracellular dopamine in fore¬ 
brain sites [21,119,120], PCP and ketamine also elevate extracellular 5-HT [22, 
121, 122], Increased dopamine and 5-HT efflux in forebrain sites might contri¬ 
bute to the psychotomimetic and antidepressant properties of these drugs. 

We have tested the effect of MK-801 on DRN 5-HT [3, 6], Compared to 
PCP and ketamine, MK-801 has higher affinity and is a putatively more se¬ 
lective noncompetitive antagonist of NMDA receptors [123, 124], Infusion of 
(+)-MK-801 (10 pM) blocked the increase in DRN 5-HT elicited by NMDA 
(100 pM). At this concentration, (+)-MK-801 did not produce a significant in¬ 
crease in DRN 5-HT. Similarly, systemic administration of (+)-MK-801 at a 
dose that blocked the effect of infusing NMDA (100 pM) into the DRN did 
not significantly stimulate 5-HT efflux. However, at higher concentrations, (+)- 
MK-801 infusion did elevate extracellular levels in the DRN. Similarly, sys¬ 
temic (+)-MK-801 at higher doses, but not the inactive enantiomer (-)-MK- 
801, produced increases in DRN 5-HT [6], 

Blocking excitatory NMDA receptors may result in increased dopamine and 
5-HT release by reducing GABA release. According to this hypothesis, GABA 
release in the area of monoaminergic cell bodies is activated by NMDA recep¬ 
tors. Thus, blocking these NMDA receptors may reduce GABA release and 
thus disinhibit monoaminergic neurons. If this hypothesis is correct, GABA re¬ 
ceptor agonists, by directly inhibiting monoaminergic neuronal activity, should 
attenuate the effect of NMDA receptor blockade. Consistent with this, systemic 
administration of pentobarbital reduced DRN 5-HT and blocked the increase 
in 5-HT produced by systemic MK-801. Similarly, local infusion of muscimol 
into the DRN blocked the effect of local infusion of MK-801 [6], 

These results are consistent with the possibility that NMDA receptors on 
GABAergic neurons are involved in tonic inhibition of DRN serotonergic 
neurons. However, in conflict with this interpretation, the competitive NMDA 
receptor blockers D-CPP and AP-5, even at high doses, had no significant ef¬ 
fect on DRN 5-HT [7], Furthermore, at low doses, non-competitive NMDA 
receptor blockers are more effective than the competitive blockers in eliciting 
hyperactivity in rats (reviewed by [125, 126]). Thus, it does not seem likely that 
the effects of MK-801 on 5-HT in rat brain are mediated by blockade of the 
NMDA receptors defined by D-CPP or AP-5 binding. With respect to the pos¬ 
sibility of additional EAA receptor subtypes, Barnard and co-workers [127] 
reported evidence of hybrid EAA receptors consisting of kainate and NMDA 
binding proteins. These heteromeric receptors had high affinity for Mg 2+ and 
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MK-801, which blocked current flow presumably by binding within the associa¬ 
ted ion channel [128], In contrast, competitive NMDA receptor antagonists 
were not effective in blocking glutamate-elicited currents [128], Perhaps, hybrid 
receptors consisting of both NMDA and non-NMDA subunits could explain 
the differential effects of the competitive and non-competitive NMDA recep¬ 
tor blockers. However, ketamine, PCP, and MK-801 have substantial affinity 
for monoamine uptake carriers and receptors [129] and nicotinic acetylcholine 
receptors [130], Thus, effects of the non-competitive NMDA receptor antago¬ 
nists on monoamine efflux and behavior may reflect multiple sites of action. 

Metabotropic glutamate (mGlu) receptors also influence 5-HT release. Ex¬ 
tracellular 5-HT in cerebral cortex increased in response to mGlu2/3 receptor 
agonists [131, 132], Because mGlu2/3 receptors are inhibitory, this presumably 
reflects indirect influences such as decreased GABA tone. Moreover, mGlu2/3 
antagonists alone did not alter 5-HT efflux, suggesting that these receptors are 
not activated tonically by endogenous glutamate under normal laboratory con¬ 
ditions. Agonists of mGlu2/3 receptors suppress REM sleep [133] and are ac¬ 
tive in animal models of anxiety [134] but no direct evidence implicates 5-HT in 
these behavioral effects. 


Physiological and behavioral significance of EAAs in the raphe 

Glutamatergic inputs mediate sensory stimulus-evoked increases in discharge 
probability of serotonergic neurons in the DRN [8] and modulation of hip¬ 
pocampal theta rhythms by serotonergic neurons in the MRN [116, 135], Ad¬ 
ditionally, glutamatergic neurons are implicated in excitatory feedback control 
of serotonergic neurons. Based on electrophysiological and neurochemical 
evidence, 5-HT 4 receptors activate glutamatergic neurons in the PFC that in 
turn feedback to stimulate serotonergic neurons in the raphe [12, 136, 137], 
Because antagonists of 5-HT 4 receptors increase 5-HT efflux, this pathway may 
exert a tonic excitatory influence on serotonergic neurons in rat raphe [138], 
The physiological significance of this positive feedback loop has not been es¬ 
tablished and apparently conflicts with the observation that glutamate receptor 
antagonists did not affect serotonergic neuronal discharge in alert cats. Pos¬ 
sibly, feedback excitation balanced by feedforward inhibition could contribute 
to sustaining steady discharge of serotonergic neurons during alert behavior in 
particular when circadian influences would otherwise dictate sleep. For exam¬ 
ple, nocturnal rodents switch their period of alert behavior if food is only avail¬ 
able during the day. In this situation forebrain inputs to the brainstem might, 
via positive feedback, help sustain activity of serotonergic neurons during day¬ 
time. In turn, 5-HT could shift the phase of circadian pacemaker neurons in 
the suprachiasmatic nucleus [139], More generally, the balance between posi¬ 
tive and negative feedback from forebrain could contribute to sensing and con¬ 
trolling responses to environmental challenges with appropriate adjustment of 
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behavior and physiology mediated in part by short-term or persistent changes 
in serotonergic neuronal discharge. 

The DRN is located within the PAG, which is replete with neuropeptides 
involved in adaptation to pain and stress. Several of these neuropeptides in¬ 
directly influence serotonergic neurotransmission. For example, Substance P 
stimulates glutamatergic inputs and thereby excites serotonergic neurons in the 
DRN [140, 141], The effects of Substance P on 5-HT have been linked to aver¬ 
sive responses, depression and anxiety disorders [142], Similar to Substance P, 
neurotensin activates glutamatergic inputs but mainly has a direct excitatory 
effect on serotonergic neurons in the DRN [143, 144], In contrast, CRF may 
stimulate GABAergic inputs and thus inhibit a subpopulation of serotoner¬ 
gic neurons in the dorsolateral DRN [33], Valentino and co-workers [33, 145] 
suggested that this CRF-related inhibition of serotonergic neurons facilitates 
struggling in the forced swim test. The evidence that CRF stimulates GABAer¬ 
gic inputs to serotonergic neurons and that this underlies struggling is indirect 
and thus, inconclusive. Moreover, the effects of CRF are mediated by two re¬ 
ceptor subtypes and vary in different regions of the DRN. In the ventromedial 
and caudal aspects of the DRN, CRF stimulates serotonergic neurons either 
directly or perhaps by inhibiting GABAergic inputs [146, 147], Thus, CRF- 
and opioid-induced disinhibition of serotonergic neurons may both contribute 
to escape deficits in the learned helplessness model of human depression [95, 
148], Together these observations suggest that some stress-related neuropep¬ 
tides either directly or indirectly activate serotonergic neurons, and this has 
been linked to passive behavior in animal models of depression and anxiety 
(reviewed in [149]). However, a variety of stressors and appetitive stimuli pro¬ 
duced similarly small increases in serotonergic neuronal discharge and release 
[71]. Accordingly, Jacobs and co-workers suggest that increased 5-HT efflux 
only reflects an increase in alert, active behavior, not a specific role in adapta¬ 
tion to stress (for review, [72]). Nevertheless, in the context of stress or fear, 
neuropeptide-induced changes in 5-HT release might alter sensory processing 
in forebrain structures, which could contribute to insomnia, anxiety, depres¬ 
sion, schizophrenia and other behavioral disorders [150-154], 

Changes in strength of excitatory and inhibitory synapses underlie learn¬ 
ing but have also been linked to psychiatric disorders (for reviews see [17, 18]). 
For example, stress and repeated administration of addicting drugs facilitate 
long-lasting potentiation of excitatory synapses on dopamine neurons [155, 
156] (reviewed by [157]). Drugs of abuse also evoke or modulate persistent 
synaptic plasticity of GABAergic synapses on dopamine neurons [156, 158, 
159], Persistent changes in synaptic strength of inputs to serotonergic neurons 
may also contribute to pathological behaviors. For example, long-term treat¬ 
ment with morphine enhanced the strength of GABAergic synapses with sero¬ 
tonergic neurons in the DRN [160, 161]. Also, Lucki and co-workers suggest 
that increased GABA tone on serotonergic neurons upon repeat exposure to 
the forced swim test contributes to reduced struggling in this animal model 
of depression (reviewed in [162]). Along with alterations in GABA transmis- 
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sion, NMDA and AMPA glutamate receptors on serotonergic neurons in the 
DRN are also implicated in escape deficits after unavoidable stress [163], These 
results provide only indirect support for the hypothesis, but studies of raphe 
slices could yield firmer evidence that a persistent change in strength of synap¬ 
tic inputs to serotonergic neurons contributes to behavioral disorders. 

In conclusion, GABAergic and glutamatergic inputs regulate the activity of 
serotonergic neurons in the mammalian raphe nuclei. Increased GABA trans¬ 
mission inhibits serotonergic neurons during sleep. This involves GABAergic 
projections to the raphe nuclei from sleep regulatory centers in the hypothala¬ 
mus and brainstem. However, GABA tone is also relatively strong during alert 
behavior. Presumably, a balance between GABAergic and glutamatergic inputs 
contributes to sustaining and regulating the discharge of serotonergic neurons 
during normal alert behavior. Many forebrain and brainstem projections to the 
raphe do not directly contact serotonergic neurons but instead control the ac¬ 
tivity of GABAergic and glutamatergic intemeurons that synapse with seroto¬ 
nergic neurons. This includes glutamatergic inputs originating in the PFC, an 
area of cortex implicated in control of emotions [164] and peptidergic inputs 
from the PAG, a brainstem area implicated in coordinating visceral and motor 
responses to a variety of aversive and appetitive stimuli [149, 165, 166], Thus, 
GABAergic and glutamatergic intemeurons in the raphe act as a final common 
pathway for integrating information from higher cognitive centers and lower 
autonomic structures and thereby controlling the activity of serotonergic neu¬ 
rons. Conceivably, stressors or appetitive stimuli could act via this final com¬ 
mon pathway to override normal circadian patterns of sleep-related control 
of serotonergic neurons. For example, if food is available only during daylight 
hours, nocturnal animals become active during the day. In this instance, in¬ 
puts from higher centers to the raphe could counteract the influence of sleep 
centers that regulate the usual period of rest and inhibition of serotonergic 
neurons. More generally, any environmental challenge that required heightened 
vigilance could thus disrupt normal day-night patterns of behavioral activity in 
part by altering the normal sleep-related inhibition of serotonergic neurons. In 
theory, prolonged stress might cause persistent changes in the balance between 
GABAergic and glutamatergic inputs to serotonergic neurons and thereby con¬ 
tribute to insomnia and anxiety, and increase susceptibility to major psychiat¬ 
ric disorders such as depression and schizophrenia. 
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Abstract 

Orexin (also called hypocretin) is a neurotransmitter that influences central arousal and 
vigilance state, especially by coupling the level of arousal to energy balance. Localized 
uniquely to neurons with cell bodies in the lateral hypothalamus, orexin has widespread 
projections throughout the neuraxis, including the raphe nuclei. Dense orexinergic inner¬ 
vation has been noted in the dorsal raphe, where direct axodendritic contacts between or¬ 
exinergic fibers and serotoninergic processes have also been described. Orexin depolarizes 
dorsal raphe serotoninergic cells, an effect that is consistent with activation of the canoni¬ 
cal form of the transient receptor potential channel. Thus, the effect of orexin will be inte¬ 
grated with other neurotransmitters that also depolarize serotoninergic cells through this 
channel, including noradrenaline and histamine. However, in addition to the direct action, 
orexin at higher concentrations also depolarizes GABAergic intemeurons and reduces glu- 
tamatergic release at local terminals through a retrograde endocannabinoid signal. The 
functional consequences of these interactions between orexin and serotonin remain to be 
elucidated, although they are consistent with synaptic modification. Hence orexin may 
modulate the serotoninergic influence in the forebrain as part of an adaptive response to 
homeostatic disequilibrium. 


Introduction 

Among advances in basic science and clinical practice of sleep medicine over 
the last decade, the discovery of the orexin (also called hypocretin) neuropep¬ 
tides, produced uniquely in the lateral hypothalamus (LH), must rank as one of 
the most important. As is now known, failure of orexin signaling is the cause 
of narcolepsy-cataplexy in humans and animals [1-3], Research is ongoing into 
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the normal functions of orexin, but it is evident, if only because of the pro¬ 
found disturbances in sleep caused by its absence, that orexin affects the regu¬ 
lation of sleep and wakefulness. In fact, data indicate that the neuropeptide 
specifically modulates the transition between vigilance states [4], Sleep is a very 
different state from wakefulness, and prolonged periods in an intermediate 
phase of drowsiness would have been evolutionarily disadvantageous. Hence, 
a mechanism would likely have evolved to ensure rapid transitions between the 
two states, and orexin appears to play a significant role in this. Similarly, the 
switch from non-rapid eye movement (NREM) to REM [5] sleep should also 
occur without a prolonged intermediate phase. The interested reader is referred 
to a more complete analysis of the neurophysiology of state transition and the 
role of orexin in these transitions [6], 

Another function of orexin appears to be related to energy balance and, 
indeed, the term “orexin” was originally chosen for the neuropeptide because 
it was localized to the LH, an area known to be important for the control of 
feeding behavior [7], There is now considerable evidence to implicate orexin in 
metabolism: for example, orexin cell discharge rate is sensitive to the level of 
circulating glucose, within the normal physiological range [8], Hence, orexin 
may link energy balance with arousal in a direct way [9] or as part of a more 
complex organization of behavioral state [10]. But it is also now apparent that 
this role of orexin may in fact be less specific than originally conceived, and it 
could be linked with general homeostatic disequilibrium [11], Under these cir¬ 
cumstances, orexin would ensure behavioral, cognitive and emotional coupling 
of the forebrain with the mechanisms of coping with disequilibrium. Negative 
energy balance would be only an example, although obviously an important 
one, of such a homeostatic disturbance. 

As the subject of intense research over many years, it is relevant to the 
interaction with orexin that serotonin (5-HT) has also been shown to affect 
these behaviors that have been linked with orexin. For example, arousal and 
vigilance states as well as body weight control have long been known to be 
affected by 5-HT (e.g., [12, 13]). Thus, the interaction between the orexin 
and 5-HT systems, the focus of this review, could be particularly important 
for a better understanding of these behaviors. Here we consider one aspect 
of the underlying mechanisms. This is hypothesized to depend on the coor¬ 
dinated interaction between orexin and 5-HT as a component of the ascend¬ 
ing arousal system. Currently available results that relate orexin and 5-HT 
emphasize the dorsal raphe nucleus (DRN), which is also of primary impor¬ 
tance for the control of vigilance states and arousal [14, 15]. Hence, this re¬ 
view highlights the DRN, although it is possible that many of these findings 
will eventually be shown to be equally applicable to the medial and caudal ra¬ 
phe nuclei. 
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The orexin neuropeptide system 

Orexins are two hypothalamically expressed neuropeptide sequences, the gene 
for which was described concurrently and independently by two groups [7, 16], 
One of these groups [7] found that orexins were endogenous ligands at two or¬ 
phan G protein-coupled receptors of previously unknown significance. These 
ligands were named orexin-A and orexin-B (i.e., hypocretin-1 and hypocretin- 
2), which comprise, respectively, 33 and 28 amino acids with a 46% homology 
(Fig. la). Both neuropeptides are products of the prepro-orexin (i.e., prepro- 
hypocretin) gene that is uniquely expressed in a discrete population of neurons, 
concentrated primarily in the LH and the neighboring perifornical area. Signif¬ 
icantly, orexin neurons project throughout the neuraxis with particularly dense 
innervation of all components of the ascending arousal system, including the 
brainstem monoaminergic and cholinergic nuclei (Fig. lb) [17]. The original 
orphan receptor used to purify orexins was named the orexin type 1 receptor 
(i.e., OXjR), and a second receptor, the orexin type 2 receptor (OX 2 R), was 
then discovered as a closely related sequence. Orexin-A has equal affinity at 
the two receptors, but orexin-B has approximately a 10-fold greater affinity at 
OX 2 R [7], The two receptors are differentially distributed throughout the cen¬ 
tral nervous system [18, 19], suggesting distinct roles for each in the functions 
of the neuropeptide. Several studies have shown that the orexins are primar¬ 
ily excitatory in their actions on the postsynaptic cell through intracellular Gq 
signaling proteins, although inhibitory coupling through OX 2 R and Gs and Gi 
has also been reported in some cells (Fig. la) [20, 21], 

Two primary symptoms of narcolepsy-cataplexy can be directly related to 
the failure of orexin signaling [22], The first, excessive daytime sleepiness, is 
the irresistible need for sleep during the day and is associated with a chroni¬ 
cally low level of alertness. The term “sleep attack” (i.e., hypersomnolence) has 
been used to describe these unavoidable brief naps in the narcoleptic patient. 
The second, cataplexy, is an abrupt decrease or loss in muscle tone, which is 
often triggered by strong emotions and occurs typically without alteration in 
the level of consciousness. Taken overall, results from narcoleptic rodents with 
genetic manipulations of the orexin system and data from canines with sponta¬ 
neous mutations of the orexin system [4], have shown that the sleep attack has 
the characteristics of an inappropriate transition from wakefulness to NREM 
sleep. This is expressed as a difficulty maintaining prolonged episodes of either 
wakefulness or sleep. In contrast, cataplexy is the expression of the features of 
REM sleep, such as atonia, intruding into wakefulness or at sleep onset [23], 
Hence these symptoms of narcolepsy result from a primary disruption of the 
regulation of sleep-wakefulness, so highlighting the importance of orexin for 
the orderly transition between vigilance states. Theoretical formulations of un¬ 
controlled switching between the vigilance states have demonstrated that the 
orexinergic innervation of the various components of the ascending arousal 
system are particularly important in this regard [24, 25], 
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◄ Fig. 1 The orexinergic system, (a) The two orexin neuropeptide sequences (orexin-A 
and orexin-B) are products of the prepro-orexin gene. Orexin-A has equal affinity for 
the OXjR receptor (an excitatory Gq-coupled receptor, represented here as activating 
an inward Ca 2+ current), and the OX 2 R receptor. The latter has been found to be both 
excitatory and inhibitory, which is represented as a Gi-coupled receptor, activating an 
outward K + current. In contrast, orexin-B has approximately a tenfold higher affinity for 
the OX 2 R. (b) Schematic representation of the orexinergic projections from the clustered 
cell bodies located uniquely around the lateral hypothalamus (LH). Note the widespread 
distribution of the orexin-containing fibers throughout the neuraxis and especially to 
centers that have been identified as being important for vigilance state control. Some of 
the most relevant anatomical centers are annotated as follows: BF, basal forebrain; DR, 
dorsal raphe nucleus; LC, locus coeruleus; LDT/PPT, laterodorsal tegmental/pedun- 
culopontine tegmental nuclei; RF, reticular formation; SC, spinal cord; Th, thalamus; 
TMN, tuberomammillary nucleus; and VLPO, ventrolateral preoptic nucleus 


Serotonin and the ascending arousal system 

Serotonin-containing neurons of the raphe nuclei discharge at a regular rate 
during wakefulness, reduce discharge rate with the onset of NREM sleep, 
and cease discharge completely in REM sleep [26], This pattern of change in 
the discharge rate with vigilance state has suggested that 5-HT is a wakeful¬ 
ness-enhancing neurotransmitter. Pharmacological studies confirm this. Thus, 
highly specific 5-HT 2A antagonists, which have only recently become available, 
enhance both NREM and REM sleep [27], Correspondingly, 5-HT uptake in¬ 
hibitors, such as fluoxetine, decrease REM sleep time and also tend to reduce 
NREM sleep by delaying sleep onset and reducing the deeper stages of NREM 
sleep [28, 29], 

However, in terms of the action of 5-HT at the cellular level in the forebrain, 
this wakefulness-promoting effect of the neurotransmitter has been more dif¬ 
ficult to confirm since 5-HT has both inhibitory and excitatory actions. For 
example, in the thalamus, an important center for transmitting excitatory influ¬ 
ences from the brainstem to the cortex, 5-HT has a depolarizing effect on the 
thalamocortical projection neurons (e.g., [30, 31]). Despite this, the primary 
response of thalamic neurons to 5-HT is hyperpolarization, mediated directly 
through the 5-HT 1A receptor and indirectly by exciting GABAergic cells [32], 
The latter include both local GABAergic interneurons and the GABAergic 
cells of the thalamic reticularis nucleus. Similar effects of 5-HT on GABAergic 
neurons have been reported in the cortex [33], These actions therefore do not 
suggest the enhancement of arousal as a primary role for 5-HT and are oppo¬ 
site to what would be predicted from the effects on sleep of pharmacological 
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manipulation of the serotoninergic system. The action of 5-HT in the forebrain 
is clearly complex. Serotonin might act, for example, in concert with other ex¬ 
citatory neurotransmitters to modulate arousal and damp over-excitation at a 
cellular level. Another possibility is that 5-HT cell discharge and/or release is 
coordinated with other components of the ascending activating system in such 
a way that the manipulated changes in extracellular 5-HT levels used in the 
in vitro studies do not normally occur in isolation in vivo. As reviewed below, 
orexin is likely to play a role in such complex effects of 5-HT, especially at the 
transition between wakefulness and NREM sleep. 

The specific quiescence of 5-HT neurons during REM sleep is also critical 
for the emergence of this state and thus for the boundary between NREM and 
REM sleep (cf. [34, 35]). In brief, noradrenergic and serotoninergic input to the 
cholinergic cells of the laterodorsal tegmentum and pedunculopontine (LDT/ 
PPT) regions in the brainstem inhibit a subpopulation of the cholinergic cells. 
Then, at the onset of REM sleep, this “REM-on” group of cholinergic cells is 
disinhibited when the 5-HT (and noradrenaline) neurons cease discharge. These 
REM-on cells project caudally to the pontine reticular formation where they 
activate groups of REM sleep effector neurons. The latter play an executive 
role in the initiation of muscle atonia, rapid eye movements and other specific 
characteristics of REM sleep [36], Hence the coordinated reduction in activity 
of the brainstem monoaminergic cell groups appears to be a controlling gate 
to REM sleep, and in fact there is considerable experimental evidence for this 
concept. For example, direct inhibition of DRN 5-HT neurons promotes REM 
sleep, whereas their stimulation decreases REM sleep [37, 38], Furthermore, 
and in the context of this review, the orexinergic influence on 5-HT cell activity 
is likely to be an important part of this control of the gate into REM sleep. 


Anatomical considerations 

In the first description of orexin projections, Peyron and collaborators [17] de¬ 
scribed a marked orexinergic innervation of the raphe nuclei, with the most 
dense labeling noted in the DRN and nucleus raphe magnus (NRM); these 
findings were confirmed by other groups in later studies [39, 40], Interestingly, 
a differential innervation of the DRN by orexin cells has been described, with 
the rostral DRN receiving input from the dorsal LH, and the caudal DRN 
being innervated primarily from the ventromedial LH [41], Subsequent inves¬ 
tigation at the electron microscope level of the orexin-containing fibers in the 
DRN found them to be axon terminals, with large dense-cored vesicles making 
synapses on both dendrites and cell bodies of the raphe neurons, although the 
latter were not confirmed as being serotoninergic in this initial investigation 
[42], However, a double-labeling study later determined that the orexin-con¬ 
taining fibers were making axodendritic synaptic contact with DRN serotonin- 
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ergic neurons [43], Furthermore, when DRN neurons were also stained for the 
OX,R receptor in this study, in addition to visualizing the serotoninergic cells, 
both axodendritic and axosomatic synapses from orexin-containing fibers were 
also seen on those orexin-receptor expressing cells that did not contain 5-HT 
[43], The latter cell bodies were smaller that the 5-HT cells, suggesting that they 
were likely to be GABAergic, a finding that implies an orexinergic influence in 
the DRN mediated directly on the 5-HT neurons and indirectly through local 
GABAergic interneurons. 

Cell groups that receive orexinergic projections have been found typically to 
project back to the LH and innervate the orexin cell field. In an early study of 
the chemoarchitecture of the LH, Abrahamson and Moore [44] found fibers 
immunoreactive to serotonin intermingled with the orexin cell bodies. These 
authors also used retrograde transport methods to show direct projections to 
the LH originating from the NRM, but they reported only an indirect, second 
order, projection from the DRN. The latter finding was confirmed by Sakurai 
and collaborators [45] who used a transgenic approach in the mouse to express 
a green fluorescent protein (GFP) in orexin cells. This protein, transferred to 
the input neurons making contact with the orexin cells, was transported in a 
retrograde direction to the corresponding cell bodies, where the GFP fluores¬ 
cence could be visualized in conjunction with 5-HT immunostaining. The re¬ 
sults showed innervation of the orexin cells from 5-HT neurons in the NRM, 
as well as the median raphe nucleus (MRN) and the nucleus raphe pallidus. 
However, no double staining was observed in the DRN. These results are thus 
not concordant with recent data from Yoshida and collaborators [46], who de¬ 
scribed strong retrograde labeling from the orexin cell field in the DRN as well 
as in other raphe nuclei in the rat. This labeling was also shown to reflect direct 
innervation of the orexin cells. Further studies are now required to examine 
these apparent discrepancies that could result from species differences. How¬ 
ever, current results can be summarized by noting that orexin and 5-HT neu¬ 
rons, especially in the rostral raphe nuclei but probably also in the caudal raphe 
nuclei, are likely to innervate each other mutually. 

In situ hybridization of the expression patterns of mRNA for the orexin 
receptors in rat brain has shown that both OX,R and OX 2 R are present in the 
raphe nuclei [18, 47^19], The densest expression of the OX,R was noted in the 
DRN, with labeling extending caudally through the NRM to the nucleus raphe 
obscurus (NRO). Similarly, dense labeling for OX 2 R was found in the DRN and 
NRM with expression continuing caudally in the pontine raphe nuclei, though 
the OX 2 R was absent in the NRO. No data are yet available as to the cell types 
that express these receptors, although, in the DRN, the electron microscopy 
study noted above [43] indicated that the OX,R is expressed on both 5-HT and 
presumed GABAergic intemeurons. Furthermore, in vivo data [50], described 
below, are consistent with the fact that 5-HT neurons in the MRN are likely 
to express primarily the OX 2 R, and that the OX,R is present on GABAergic 
interneurons in this nucleus. 


294 


Christopher M. Sinton 


Orexin directly influences serotoninergic cell activity 

Soon after the discovery of the influence of the orexin system on sleep and 
wakefulness, it was reported that orexin-A potently excited DRN 5-HT neu¬ 
rons [51]. The depolarization induced by orexin-A was not blocked by tetro- 
dotoxin (TTX), indicating a direct postsynaptic effect, which was apparently 
accompanied by an increase in input resistance. Without further study at that 
time, the latter was taken as indicative of a potassium leak current. As this 
work continued, however, it became evident that this change in input resistance 
was variable and that depolarization could even be observed in the absence of 
any change to input resistance [52], Furthermore, voltage clamp experiments 
revealed that a potassium current could not be responsible for the change in 
input resistance. By comparing the effects of orexin-A and orexin-B, and using 
the different affinity of the two ligands at the orexin receptors, the depolarizing 
response was found to be mediated by the OX 2 R receptor. These results with 
orexin were closely comparable with a previously established depolarizing effect 
on 5-HT neurons of agonists at the a 1-adrenoceptor, another Gq coupled re¬ 
ceptor. Indeed, orexin-A and phenylephrine, an a 1-adrenoceptor agonist, when 
applied in combination to the same 5-HT cell were not additive in their effect, 
suggesting a common intracellular mechanism. This finding was then also ex¬ 
tended to agonists at the histamine H 2 receptor. In summary, therefore, agonists 
at the OX 2 R, a 1-adrenoceptor and H, receptors were found to depolarize 5-HT 
DRN neurons through a common postsynaptic mechanism. This commonality 
was shown by the close similarities in the characteristics of the inward currents 
produced and the lack of additive effects when the agonists were applied in 
combination. Taken overall, these results were consistent with the involvement 
of a nonselective cation channel, possibly the canonical form of the transient 
receptor potential (TRPC) channel, in the excitatory response of 5-HT neurons 
to orexin and the other arousing neurotransmitters (cf. Fig. 2). 

The recently identified TRP channels are ubiquitously expressed in cells, in¬ 
cluding neurons [53], TRP channels form a superfamily, of which the C-type (or 
canonical) can itself be grouped into several different subtypes. TRPC channels 
mediate signals from phospholipase C-coupled receptors (i.e., including those 
that are Gq coupled), and act as nonspecific cation channels. The expression 
of TRPC channels was confirmed in DRN 5-HT neurons that also co-express 
orexin receptors, a result that is strongly supportive of the hypothesis that the 
depolarizing effect of orexin on serotoninergic cells is mediated through these 
channels (Fig. 2) [54], Importantly, the TRPC channel can be considered as 
an integrator of the responses to different concurrent receptor activation, for 
example in the case of 5-HT cells to the arousing neurotransmitters. It is also 
notable that by allowing entry of both Ca 2+ and Na + ions, TRPC channels can 
mediate not only the membrane potential and discharge rate of cells, but also 
intracellular processes that are Ca 2+ -activated [53, 55], Current data suggest 
that serotoninergic cells are unique amongst the aminergic cells in co-express- 
ing orexin receptors and TRPC channels [54], 
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Fig. 2 Orexin directly excites serotonergic neurons in the DRN. This depolarizing effect 
has been shown to be probably mediated in the DRN primarily at the OX 2 R receptor 
coupled to the canonical form of the transient receptor potential (TRPC) channel. The 
TRPC is a nonselective cation channel, represented as allowing the passage of both Ca 2+ 
and Na + ions across the membrane. Importantly, the TRPC channel in DRN 5-HT neu¬ 
rons is also coupled to other receptors, including the al-adrenoceptor and the histamine 
Hj receptor. With a common mechanism, these afferent actions on 5-HT neurons will be 
integrated by the TRPC channel. Activation of the OX 2 R on 5-HT neurons also releases 
an endocannabinoid (EC) signal from the membrane. See text for details 


The depolarizing effect of orexin on serotoninergic cell activity translates 
into 5-HT release in vivo in the raphe nuclei. Using a reverse microdialysis tech¬ 
nique, Tao and collaborators [50] infused either orexin-A or orexin-B into the 
DRN and MRN of freely moving rats. They noted that orexin-A dose-depend- 
ently increased 5-HT release when infused in the DRN, but it had no effect 
in the MRN. In contrast, orexin-B had a similar, although less potent effect 
on 5-HT release when infused in either raphe nucleus. These results are only 
partially explicable in terms of differential orexin receptor expression on 5-HT 
neurons if it is assumed that OX 2 R predominates for this effect in the DRN 
and OX 2 R predominates in the MRN. However, as noted above, the direct ex¬ 
citatory response of orexin in vitro was more likely to be mediated by OX 2 R in 
the DRN. Thus, the presence of local glutamatergic and/or GABAergic influ¬ 
ences that are modulated by orexin, probably at OX 2 R and OX,R, respectively, 
must be invoked to provide a better model for these data. Indeed, both GABA 
and glutamate exert a tonic influence on DRN and MRN 5-HT cells and these 
actions differ in potency between the two raphe nuclei [56-59], Such indirect 
effects of orexin on GABA and glutamate release have also been observed in 
electrophysiological studies in the DRN (see below). 
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Orexin indirectly influences serotoninergic cell activity 

In addition to the depolarizing influence of orexin on DRN 5-HT activity, the 
neuropeptide also increases the discharge frequency of local GABAergic inter¬ 
neurons at concentrations that are approximately double those effective for the 
direct action [60], GABAergic intemeurons inhibit the 5-HT cells, so resulting 
in an indirect inhibition of 5-HT cells by orexin (Fig. 3). This action was re¬ 
vealed by an increase in inhibitory postsynaptic currents when orexin was ap¬ 
plied in vitro, a result that supports the anatomical data showing the presence 
of synapses between the orexin fibers and presumed GABAergic intemeurons 
in the DRN. At higher rates of discharge, therefore, the orexin influence in the 
DRN will include a negative feedforward action, which will damp the direct 
depolarizing effect of the neuropeptide. This might be relevant to the change 
in 5-HT cell activity over the sleep-wake cycle since Gervasoni and collabora¬ 
tors [61] have shown that GABA release in the DRN is likely to be responsible 
for the decrease in 5-HT cell discharge rate from wakefulness through NREM 
sleep to REM sleep. This GABA was found to originate from afferents to the 
DRN in addition to release from the local interneurons. However, no data are 
yet available to address specifically the question of whether orexin in the DRN 
might also affect the release of GABA from afferents to the raphe in addition 
to the effects of the neuropeptide on local intemeurons. Hence, the orexinergic 
influence in the raphe might at least partially modulate the state-related change 
in activity of 5-HT neurons. However, independent of such state-related effects, 
it is evident that the excitatory effect of orexin on DRN 5-HT neurons will be 
self limiting because of the accompanying action on local GABAergic inter¬ 
neurons at higher concentrations. 

Like GABA, glutamatergic afferents are present in the DRN and glutamate 
has been shown to influence DRN 5-HT neuronal activity [57], Furthermore, 
a recent in vitro study showed that orexin also modulates this glutamatergic 
influence in the raphe [62], The most significant glutamatergic afferent to the 
DRN originates in the medial prefrontal cortex, with secondary processes from 
the hypothalamus and the LDT/PPT [63], This glutamatergic input to the DRN 
from the forebrain suggests a descending feedback influence onto the 5-HT sys¬ 
tem during arousal and wakefulness that is gated through higher level process¬ 
ing. Indeed, endogenous glutamate has a less significant role in controlling the 
tonic discharge of 5-HT neurons than GABA, and glutamate thus has little 
influence on the change in 5-HT neuronal discharge rate that is correlated with 
the vigilance state [64], However, glutamate effectively modulates the serotonin¬ 
ergic response to phasic, or orienting, stimuli and this is likely to reflect the link 
with forebrain processing [64], In addition, the endogenous glutamatergic tone 
in the raphe can be potentiated by direct local pharmacological activation of 
glutamate receptors in the DRN with kainate [65], This manipulation increases 
wakefulness, indicating that activating 5-HT cell discharge via glutamate recep¬ 
tors can enhance arousal. 
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Fig. 3 A schematic representation of the likely synaptic relationships between a lateral 
hypothalamic (LH) orexinergic (OXL) neuron and a serotoninergic (5-HT) neuron in the 
dorsal raphe nucleus (DRN). As shown in Fig. 2, the depolarization of 5-HT dendrites 
induced by the orexin signal is mediated primarily through the OX 2 R, though the OXjR 
is also present on the dendrites and soma of 5-HT neurons in this nucleus. This action at 
the OX 2 R also releases an endocannabinoid (EC) signal that acts in a retrograde fashion 
across the synapse to inhibit local glutamatergic (Glu) processes. This inhibition reduces 
the Glu excitatory drive on 5-HT neurons. The orexinergic innervation to the DRN also 
activates local GABAergic interneurons, which in turn increase the inhibition of 5-HT 
neurons. Thus, the direct depolarizing effect of orexin in the DRN is damped by at least 
two feedforward inhibitory effects. The orexin/5-HT loop is completed by serotoninergic 
projections from the raphe nuclei, possibly including the DRN, to the LH orexin cells, 
which are inhibited by 5-HT acting at the 5-HT 1A receptor 


Thus, an apparent role of glutamate in the DRN is to provide feedback from 
the forebrain to gate the serotoninergic response to phasic and salient stimuli. 
As orexin modulates this glutamatergic influence in the raphe, it indicates that, 
at least in part, orexin might affect the orienting response through the seroto¬ 
nergic system. Interestingly, the influence of orexin-B on glutamate transmis¬ 
sion in the DRN results from the release of an endogenous cannabinoid (i.e., 
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an endocannabinoid) from the 5-HT neurons (Fig. 3) [62], Endocannabinoids 
are retrograde signals that travel back across the synapse to modulate the pre- 
synaptic neuron [66, 67], In this case, therefore, the presynaptic target for the 
endocannabinoid is the glutamate terminal, where glutamate release is inhibi¬ 
ted by action of the endocannabinoid at the CB, receptor. These endocannabi¬ 
noid signals have been found to be produced by different mechanisms depend¬ 
ing on the synapse involved. Here, it is driven directly through phospholipase 
C stimulation coupled to the orexin Gq receptor, and thus, interestingly, the 
same mechanism that couples to the TRPC channel. However, in this study the 
increase in intracellular Ca 2+ that accompanies orexin receptor activation was 
not found to enhance the signal, although the effect of bursts of stimulation 
to mimic orexin cell activity was not investigated [62], At other synapses, the 
pattern of synaptic activity is known to be important for producing a Ca 2+ en¬ 
hancement of the endocannabinoid signal [66], Until such an enhancement is 
investigated, therefore, it cannot be ruled out here. In summary, orexin innerva¬ 
tion of the DRN serotoninergic neurons, likely acting at the OX 2 R, modulates 
concurrent glutamatergic input by transiently reducing the terminal release of 
glutamate through a retrograde endocannabinoid signal. 


Serotonin influences orexinergic cell activity 

Even if synaptic innervation has not yet been described, the direct serotoniner¬ 
gic input to the orexin neurons (see above: Anatomical considerations) suggests 
that 5-HT should affect the activity of orexinergic cells. This was confirmed in 
vitro when 5-HT was found to inhibit discharge rates and hyperpolarize orexin 
cells, an effect that was not blocked by TTX, indicating a direct action [68, 69], 
A subsequent study examined this action in more detail and reported that the 
effect was mediated via the 5-HT IA receptor (Fig. 3) [70], This study also estab¬ 
lished that the 5-HT 1A receptor was colocalized with orexin immunoreactivity 
in LH cells and that, in transgenic mice that do not express orexin, a 5-HT 1A 
antagonist did not increase motor activity as it did in wild-type mice. Support¬ 
ing these in vitro results, Kumar and collaborators [71] infused 5-HT into the 
LH of freely moving rats and noted that the neurotransmitter inhibited the dis¬ 
charge rate of presumed orexinergic cells, which were concurrently recorded. 


Orexin and serotonin: a summary of the interactions 

Orexin and 5-HT neurons are in a negative feedback loop, since orexin depolar¬ 
izes 5-HT cells while 5-HT hyperpolarizes orexin cells. However, this mutual 
influence will depend on the raphe nucleus being considered because of dif¬ 
ferences in the relative expression of the orexin receptors and the projections 
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themselves. Furthermore, as reviewed above from data obtained in the DRN, 
the influence of orexin in the raphe nuclei is more complex than the direct ex¬ 
citatory effect. 

It is notable that aspects of this complexity indicate an integrative role for 
orexin or suggest a mechanism involving synaptic change or adaptation. First, 
by acting through a final intracellular common pathway coupled to the TRPC 
channel, the depolarizing influence of orexin on 5-HT cells operates in concert 
with other arousing neurotransmitters, including noradrenaline and histamine. 
These influences are integrated through the TRPC to set not only the mem¬ 
brane potential and thus the discharge rate of the 5-HT cells, but also the entry 
of Ca 2+ into the cell. The former may ensure the consistent and steady discharge 
of 5-HT cells under normal conditions during wakefulness. The latter could act 
on multiple intracellular components affecting, for example, the response of 
5-HT cells to subsequent synaptic input. 

Second, at relatively higher local concentrations, orexin activates a feedfor¬ 
ward negative effect through GABAergic intemeurons and possibly GABAer- 
gic terminals. The GABAergic tone in the raphe is important for the regulation 
of the spontaneous discharge rate and release of 5-HT, including the change 
associated with vigilance state. Orexin may therefore influence the change in 
5-HT cell activity associated with sleep and wakefulness, and so integrate that 
activity with other components of the ascending arousal system. 

Third, orexin inhibits glutamate release in the raphe by a retrograde endo- 
cannabinoid mechanism that is driven from the 5-HT neurons and linked to 
phospholipase C levels, i.e., the same intracellular signal that couples to the 
TRPC channel. The functional importance of endocannabinoids in neuronal 
signaling remains to be determined, although current data suggest that they 
may be involved in synaptic plasticity. Since the glutamatergic input to the 
raphe is primarily a descending forebrain influence that is affected by phasic or 
orienting stimuli, the implication is that orexin modulates the serotonergic re¬ 
sponse to significant stimuli. As noted in the introduction, orexin cell discharge 
is activated by homeostatic disequilibrium, including that associated with en¬ 
ergy imbalance, and this response could therefore aid in the adaptation that is 
required when equilibrium is disturbed. 


Functional implications 

The close reciprocal regulation between the serotoninergic and orexin systems 
at the cell body level suggests that many functional effects, especially those in¬ 
volving arousal, vigilance state control and energy homeostasis, will depend on 
both systems. Furthermore, both 5-HT and orexin innervate largely overlap¬ 
ping forebrain structures, and hence the expression of behaviors modulated by 
either 5-HT or orexin is also likely to be altered in the terminal areas by the 
other neurotransmitter. This could reflect presynaptic or postsynaptic modula- 
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tion. As an example of the former, stimulation-induced release of 5-HT from 
rat hypothalamic neuronal terminals is inhibited in vitro by orexin [72], In con¬ 
trast, postsynaptic interaction is more likely to play a role in the blockade in the 
rat of orexin-A-induced grooming behavior by pharmacological 5-HT antago¬ 
nism, including 5-HT 2 antagonists [73] and a specific 5-HT 2C antagonist [74], 

Much work remains in this area both to understand the terminal field inter¬ 
action between the neurotransmitter systems, and the functional consequences 
of regulation at the cell body level. In fact, food intake and energy balance are 
currently subject to considerable research interest and likely to yield relevant 
results. The expression of 5-HT 1A receptors on orexin-containing neurons is an 
instance of this, since the 5-HT 1A receptor has been shown to mediate food in¬ 
take [75], The relationship between homeostatic equilibrium and sleep ensures 
that such findings will be directly relevant to vigilance state control. 

Similarly, the coordination of vigilance state with the discharge activity of 
both 5-HT and orexin neurons is another significant research area. This is par¬ 
ticularly relevant to the gating of REM sleep, which, as reviewed above, is criti¬ 
cally dependent on both systems. In this regard, a recent preliminary report ex¬ 
amined the delayed REM sleep rebound that follows restraint stress in rats and 
some strains of mice [76], Mice lacking the serotonin transporter (i.e., SERT'~, 
or mice with chronically enhanced levels of 5-HT) demonstrated this stress- 
induced REM sleep rebound only when pretreated with an OX,R antagonist. 
SERT '- mice have enhanced REM sleep time at baseline, an effect assumed to 
result from compensatory changes during development, since acute increases 
in 5-HT have the opposite effect in the adult [77] (see Serotonin and the ascend¬ 
ing arousal system). As REM sleep regulation is likely to reflect brainstem ef¬ 
fects related directly to the regulation of 5-HT cell activity, this may be a useful 
model to examine changes in the orexinergic regulation of the 5-HT system. 
In so doing, the functional consequences of the link between these important 
systems may become more apparent and the relationship between REM sleep 
regulation and the maintenance of homeostasis better understood. 
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Abstract 

Many clinical anecdotes and an experimental study have reported intensification of 
dreaming by the selective serotonin-reuptake inhibitors (SSRIs). However, no published 
neurochemical dream model invokes serotonin as a dream-promoting neuromodulator 
or accounts for serotonergic dream enhancement. An experimental study of normal vol¬ 
unteers showed that, although SSRI treatment decreased dream recall frequency, several 
subject-rated dream-intensity measures were greater during steady-state drug admin¬ 
istration compared with pre-drug baseline and early drug treatment. Additionally, such 
subject-rated dream intensity as well as dream report length and judge-rated bizarreness 
were greater during acute discontinuation than during pre-drug baseline and drug ad¬ 
ministration periods. Nightcap ambulatory monitor data showed increased REM latency 
during treatment and increased REM density during acute discontinuation, indicative of 
SSRI-induced REM suppression and REM rebound following drug discontinuation, re¬ 
spectively. The bulk of pharmacological evidence suggests that drugs that enhance seroto¬ 
nergic neurotransmission lighten sleep. Sleep-disruptive effects of SSRIs are accompanied 
by electroencephalographic and electromyographic signs of brain activation, abnormally 
prominent eye movements in NREM sleep, and REM rebound following drug discontinu¬ 
ation. Explanations of SSRI-induced dream intensification suggested by these findings in¬ 
clude, respectively, generalized brain activation during sleep, enhanced NREM dreaming, 
and within-night REM rebound. Additional clues as to potential causes of serotonergic 
dream enhancement are provided by: (i) the cellular pharmacology of hallucinogens that 
act on 5-HT 2A receptors, (ii) the phenomenological and functional neuroimaging effects 
of serotonergic hallucinogens, and (iii) putative neurophysiological mechanisms of lesion- 
related complex hallucinosis. 
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Introduction 

Reports of direct effects on dreaming by endogenous serotonin (5-HT) or by 
pharmaceutical agents impacting serotonergic neurotransmission are rare as, 
indeed, is direct evidence for dream effects of any other endogenous neuro¬ 
chemical or its exogenous modulators (i.e., agonists, antagonists, reuptake 
inhibitors, degradatory enzyme inhibitors, presynaptic releasers). This is, of 
course, because the experiments with animals that have been so usefully em¬ 
ployed to describe the neurochemical modulation of sleep are uninformative 
with regard to a behavior that depends upon verbal report of a subjective expe¬ 
rience. Nonetheless, biopsychological models of dreaming have been proposed 
that invoke roles for endogenous neuromodulators based upon animal studies 
of behavioral state control, clinical anecdotes and the few extant human ex¬ 
perimental pharmacology reports (see [1-3] for reviews). Several recent reviews 
on the pharmacology of nightmares [4-6] have also provided valuable data for 
speculation on neurochemical factors in dreaming. 

Interestingly, although clinical anecdotes [7, 8] and an experimental study 
[9] have reported intensification of dreaming by the selective serotonin reup¬ 
take inhibitors (SSRIs), none of the three major neurochemical dream models 
invoke serotonin as a dream promoting neuromodulator (see [3, 10,11]). More¬ 
over, two of these models specifically cite diminished serotonergic modula¬ 
tion in REM as a contributing factor in dreaming. Specifically, the activation 
synthesis/AIM model of Hobson and Me Carley [3] suggests that the nadir of 
serotonergic (and noradrenergic) tone in REM sleep enhances the relative fore- 
brain-activational importance of acetylcholine (ACh) in determining the formal 
characteristics of dreaming. This is because the ascending cholinergic system 
becomes the major neuromodulatory system activating the diencephalon and 
cortex during REM [3], Likewise, the psychotomimetic theory of Gottesmann 
[10, 12] suggests that the relative importance of dopaminergic neurotransmis¬ 
sion during dreaming is enhanced by the absence of serotonergic inhibitory 
influence on the forebrain in REM. 

Although the complex neurochemistry underlying dreaming (as well as any 
other behavioral state) is unlikely to be reducible to a simple interaction of a 
few neuromodulatory systems [2, 6, 13], the question remains as to why exo¬ 
genously enhanced serotonergic neurotransmission appears to enhance dream¬ 
ing in at least some individuals. 


Effects of serotonergic drugs on dreaming 

Enhancement of dreaming has been noted during treatment of mood and anxi¬ 
ety disorders with the SSRIs fluoxetine [7, 9, 14, 15] and citalopram [16]. Our 
preliminary unpublished interview data suggest that, in patients treated for 
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such disorders, three dimensions of dreaming commonly enhanced by SSRIs 
are visual vividness, movement and bizarreness. Alterations of dream content 
have been noted with sertraline [17] and an elevation of a composite salience 
variable (combining vividness, bizarreness, emotionality and color) in dream 
reports has been reported for pyridoxine, which participates in the conversion 
of tryptophan to serotonin [18], Tramadol, an opioid analgesic that also in¬ 
hibits 5-HT reuptake, is reported to enhance dreaming especially when given 
concomitantly with an SSRI [19] and has even been reported to increase intra¬ 
operative recall and dreaming when used in surgery [20], However, SSRIs do 
not enhance all features or all types of dreaming. For example, in post-trau¬ 
matic stress disorder (PTSD), fluvoxamine reduces the number of trauma-re¬ 
lated dreams [21] and, although the SSRIs enhance dream intensity, their acute 
effect in normal subjects was to decrease the proportion of days with spontane¬ 
ous dream reports [9], 

Specifically in depressed patients, it is important to note that reported effects 
of antidepressants on dreaming involve an interaction of several factors. The 
first is the observation that, in many depressed individuals, REM latency is 
shortened and REM density (eye movements per minute in REM) is increased 
[22], Despite this augmentation of the sleep stage most conducive to dreaming, 
empirical findings suggest there is reduced dream recall in depressives com¬ 
pared to normals [23], Furthermore, additional reduction in rate of dream re¬ 
call over pre-treatment baseline with recovery has been reported using some 
antidepressants [15, 23] but not the SSRI fluoxetine [15], Therefore, in pharma¬ 
cologically treated depressives, the behaviorally expressed dream frequency and 
quality is affected by factors including: depression-related dream suppression, 
recovery-related dream enhancement or suppression, and depression-related 
REM enhancement but drug-related REM suppression. Furthermore, one can¬ 
not separate the relative importance of dream production versus dream recall 
in subjective reports. 

Therefore, it is particularly informative to look at SSRI effects on dreaming 
in psychiatrically healthy individuals. Pace-Schott et al. [9] studied the effects 
of the SSRIs paroxetine and fluvoxamine on 14 healthy volunteers (4 males, 10 
females; mean age 27.4 years, range 22-39). Participants underwent a 31-day 
home-based study beginning with a 7-day drug-free baseline, then 19 days on 
either 100 mg fluvoxamine or 20 mg paroxetine in divided morning and evening 
doses (the last 9 days of treatment were considered steady state based on drug 
half-lives), and finally, 5 days of acute discontinuation. Upon spontaneous 
awakening each morning, participants wrote reports of any dreams recalled, 
self-scored specific emotions in their reports and, using 5-point Likert scales, 
rated seven general dream characteristics. In addition, three judges indepen¬ 
dently scored dream reports for bizarreness, movement and number of visual 
nouns using published scales [24-26], The Nightcap ambulatory sleep monitor 
[27] was used to record REM-sleep parameters (REM latency and eyelid move¬ 
ments per minute) as well as general sleep quality measures. 
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Results showed that mean dream recall frequency decreased during treatment 
compared to baseline (Fig. la), while report length (Fig. lb) and judge-rated 
bizarreness (Fig. lc) were greater during acute discontinuation than during 
baseline or treatment. Treatment-associated decreased dream recall frequency 
was particularly notable for paroxetine treatment, while discontinuation-related 
increase in word count and bizarreness was particularly seen in fluvoxamine 
treatment (Fig. la-c). Subject-rated dream-intensity measures of memorabil¬ 
ity, visual vividness, amount of sound, emotional intensity, and meaningfulness 
were greater during steady-state drug and acute discontinuation compared with 


Frequency of Producing Dream Report 
(N-14, p-.0816) 


b Mean Word Count of Dream Report 
Both Drugs Combined 
(N-l 1, p < 0.01) 




C Mean Total Number of Bizarre Item 
Both Drugs Combined 
(N-11, p < 0.01) 



Fig. 1 The effect of paroxetine and fluvoxamine treatment on dream frequency (a), re¬ 
port length (b) and judge-rated bizarreness in 14 normal subjects. BA= baseline (days 1- 
7); IN=increasing plasma levels (days 8-17); SS=steady state (days 18-26); WD=acute 
discontinuation (days 27-31). An alpha level of p<0.0083 was established for the means 
comparisons by a Bonferroni correction for six contrasts. Bars indicate standard error 
of the mean 
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pre-drug baseline and early drug treatment (Fig. 2). Interestingly, intensity rat¬ 
ings did not consistently correlate with dream recall frequency or word count, 
suggesting that the physiological processes underlying these two types of SSRI 
effects on dreaming may differ. 

REM latency was increased during treatment compared to baseline and 
acute discontinuation (p<.01, whereas intensity of REM sleep, indexed by 
eyelid movement density, increased during acute discontinuation compared to 
baseline and treatment (p < 0.1). In addition, a statistically significant decrease 
in sleep “rhythmicity” (Fig. 3), a 5-level score assigned to graphically presented 
Nightcap data by judges blind to subject identity or stage of treatment, was ob¬ 
served [28], (The rhythmicity score goes from 5 “Clearly alternating periods of 
eyelid movement activity and eyelid movement near quiescence approximating 
the REM/NREM ultradien period” to 1 - “Record lacks clear periods of activ¬ 
ity and less activity.”) In the same subjects whose dreams were studied, rhyth¬ 
micity was significantly lower during drug treatment as compared to baseline 
and acute discontinuation ([28], see Fig. 3). 


Visual Vividness of Dreaming 
Both Drugs Combined 
(N-12, p < 0.05) 


Memorability of Dreaming Emotional Intensity of Dreaming 
Both Drugs Combined Both Drugs Combined 

(N-12, p< 0.05) (N-12,p<0,01) 



Meaningfulness of Dreaming 
Both Drugs Combined 
(N-12, p< 0.05) 


Amount of Sound in Dreaming 
Both Drugs Combined 
(N-12, p< 0.05) 



Fig. 2 The effect of paroxetine and fluvoxamine treatment on nightly subject-ratings of 
dream qualities. The study used a 5-point Likert scale (1 = highest) in 14 normal sub¬ 
jects. The phases of the study and statistical measures are as indicated for Fig. 1 
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Fig. 3 Nightcap eyelid movement channel showing sleep architecture changes in a single 
subject before, during and after treatment with paroxetine. Note loss of pre-treatment 
clear differentiation between REM and NREM periods, a change quantified by a dimi¬ 
nished “rhythmicity” score in Silvestri et al. [28], Note also the powerful REM rebound 
following drug discontinuation 


Alterations of human sleep electrophysiology 
by serotonergic drugs 


The globally activating effects of the SSRIs are reflected in their well-known 
alerting and sleep disruptive effects including increased sleep latency and wake 
time after sleep onset as well as decreased sleep efficiency [29-34], For exam¬ 
ple, fluoxetine has been shown to elevate arousal index and lower sleep effi¬ 
ciency [30], Notably, acute sleep disruptive effects have been reported for both 
fluvoxamine [31] and paroxetine [35, 36], In the dream study reviewed above, 
Nightcap data showed that SSRI-induced sleep disruptive effects occurred in 
the form of increased number of awakenings, reduced sleep efficiency as well as 
both a global and NREM-specific increase in eyelid movement density [28], 
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In polysomnographic studies, sleep disruption by SSRI treatment has been 
shown to be accompanied by electrophysiological signs of brain activation 
such as increased power in EEG fast frequencies and decreased delta activity 
in NREM sleep [30, 33, 37-39], For example, chronic treatment with fluoxe¬ 
tine produced an increase in stage 1 over baseline at the expense of the deeper 
stages of NREM [39], Added signs of the activating effects of the SSRIs are 
associated motor abnormalities such as periodic limb movements [40], REM 
sleep behavior disorder [41], and bruxism [42], Fluoxetine has been associated 
with an increase in EMG amplitude in all stages of sleep [37, 43], A motor ab¬ 
normality specifically associated with SSRI treatment and possibly related to 
the phenomenon of SSRI-induced dream intensification is the appearance of 
abnormally prominent eye movements in NREM sleep [14, 30, 38, 41, 44, 45], 
Notably, elevation of EMG is temporally associated with periods of increased 
NREM eye movements [45], The fact that REM sleep behavior disorder can 
be aggravated [46] or even induced by SSRIs [41] constitutes further evidence 
of an interference with atonia possibly being a factor in SSRI-induced dream 
intensification. 

Even more indicative of the activating, desynchronizing effects of serotonin 
is the fact that the 5-HT 2A and 5-HT 2C antagonists ritanserin and ketanserin 
are among the few pharmacological agents known to increase slow wave sleep 
(SWS) and delta activity [71-78], Similarly, the newer 5-HT 2 antagonist, SR 
46349B, increased spectral power in the delta frequency (0.75-4.5 Hz) and de¬ 
creased power at spindle frequencies [79], Therefore, substances such as ritan¬ 
serin and ketanserin that antagonize post-synaptic 5-HT 2 receptors promote 
SWS, while substances that increase extracellular 5-HT, such as the SSRIs, in¬ 
terfere with SWS [33], 


Pharmacology of serotonergic effects 
on REM sleep and dreaming 


The SSRIs are believed to enhance central serotonergic neurotransmission via 
desensitization of 5-HT autoreceptors [67], Although serotonergic and norad¬ 
renergic antidepressants acutely suppress REM sleep, REM gradually recovers 
with the SSRIs, although it may remain suppressed much longer by the mono¬ 
amine oxidase inhibitors [68-70], 

Cholinergic rebound following cholinergic suppression by aminergic drugs 
may contribute to the intensification of REM sleep and dreaming reported dur¬ 
ing discontinuation of tricyclic and SSRI antidepressants [47, 48], Discontinu¬ 
ation of aminergic antidepressants results in REM rebound even in the long 
half-life SSRI fluoxetine [49], Paroxetine and fluvoxamine have the briefest half 
lives of currently prescribed SSRIs (with means of 21 and 15 h, respectively) 
and neither have active metabolites [50], Rapid elimination half-lives of these 
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drugs suggest that their discontinuation might produce REM sleep and dream¬ 
ing effects attributable to REM rebound, a condition known to be associated 
with intensified dreaming and nightmares [51]. Indeed, paroxetine is the SSRI 
most often associated with a withdrawal syndrome [47], 

As predicted by the reciprocal interaction hypothesis [52], cholinergic drugs 
potentiate REM sleep [22, 53-57], while aminergic drugs, such as the SSRIs, 
suppress REM [6,32,49, 58,59], Based upon reciprocal interaction, its succeed¬ 
ing Activation-Synthesis and AIM dream models [3, 60] predict that choliner¬ 
gic drugs should enhance and aminergic drugs suppress dreaming. Supporting 
this prediction, cholinergic agonists can induce REM sleep with dreaming [57]; 
transdermal nicotine and the nicotinic partial agonist varenicline can intensify 
dreams [61, 62], albeit with decreased REM percent using nicotine [61]; and 
cholinesterase inhibitors such as donepezil can potentiate nightmares [63-65], 
as can noradrenergic beta-blockers [4-6, 66], Although the details of Activa¬ 
tion Synthesis and AIM models can be debated (see discussions in [6, 61]), 
pro-cholinergic and anti-aminergic enhancement of dreaming is supported by 
the weight of evidence. However, enhancement of dreaming by potentiating 
serotonergic neurotransmission with SSRIs is in the opposite direction to this 
general pattern and it is interesting to consider why this might be so. 


Evidence from animal studies: 

Cellular neurophysiology of serotonergic hallucinogens 


The visual dimensions of dreaming are clearly analogous to complex visual 
hallucinations [80, 81], Serotonergic hallucinogens, including indolamines like 
LSD and psilocybin, tryptamine derivatives such as /V,A-dimethyltryptamine 
(DMT) and the phenylethylamines such as mescaline, produce their effects by 
interfering with the brain’s 5-HT system. The main site of action for serotoner¬ 
gic hallucinogens is believed to be presynaptic 5-HT 2A receptors located on ex¬ 
citatory glutamatergic inputs to apical dendrites of cortical layer V pyramidal 
cells [82], At these presynaptic sites, serotonergic hallucinogens act as partial 
serotonin agonists that prolong glutamate release and consequent excitation 
of the postsynaptic membrane via a mechanism of “asynchronous” glutamate 
release, which develops slowly after the larger action-potential mediated (“syn¬ 
chronous”) release of neurotransmitter has occurred. This late slow form of 
glutamate release induces prolonged excitatory post-synaptic potentials (EP- 
SPs) that are hypothesized to underlie the cognitive-perceptual effects of these 
hallucinogens [82], 

While hallucinogens acting upon 5-HT 2A receptors promote asynchronous 
neurotransmitter-release mediated EPSPs, 5-HT itself does not due, presum¬ 
ably, to its actions at other inhibitory sites such as 5-HT, regulatory autorecep- 
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tors [82], However, under conditions of decreasing 5-HT concentration, these 
EPSPs emerge and Aghajanian and Marek [82] speculate that conditions of 
low 5-HT may generally favor asynchronous transmitter release-evoked EPSPs. 
The naturally occurring lowest levels of 5-HT occur during REM, while fluctu¬ 
ations of 5-HT release occur during sleep stage transitions [3], Such conditions 
may, therefore, promote the naturally occurring hallucinosis of dreaming [2], 
Recent radioligand binding studies of narcolepsy patients have shown that 
serotonin receptor availability is increased during sleep [83], Such increased re¬ 
ceptor availability in sleep reflects decreased release of endogenous 5-HT and, 
in keeping with past animal studies, endogenous 5-HT release in humans has 
been recently shown to markedly decline further in an ultradian manner from 
NREM to REM periods [84], Such increased receptor availability and low levels 
of endogenous 5-HT may render the brain especially susceptible to fluctua¬ 
tions in levels of 5-HT induced by reuptake blockade. As noted by Aghajanian 
and Marek [82], low or decreasing levels of endogenous 5-HT may promote 
the asynchronous presynaptic glutamate release and consequent postsynaptic 
EPSPs in response to 5-HT itself that are seen in response to hallucinogens at 
normal waking levels of 5-HT. 


Effects of serotonergic drugs on waking 
consciousness relevant to dreaming 


In addition to visual hallucinosis, serotonergic hallucinogens produce altera¬ 
tions of thinking, emotional changes and dissociated states with some phe¬ 
nomenological similarities to dreaming [81]. The effects on humans of psilo¬ 
cybin, an hallucinogenic mixed 5-HT, and 5-HT 2 agonist, have been studied 
as an experimental model of psychosis by Vollenweider and colleagues [85] 
and their findings have relevance to dream phenomenology. This agent signifi¬ 
cantly elevates ratings of “dreaminess” on psychometric rating scales. Using 
[ 18 F]fluorodeoxyglucose (FDG) PET, these investigators have found that psilo¬ 
cybin intoxication is accompanied by a hyperfrontal pattern of brain activity 
[86] that, like REM sleep [87-89], was particularly apparent in anterior cingu¬ 
late and other medial frontal areas but, unlike REM also involved activation 
lateral frontal cortices. (Note, however, that Nofzinger et al. [87] found greater 
lateral frontal activity in REM using FDG PET than did Braun et al. [89, 90] 
and Maquet et al. [88] who used ls O methods.) Vollenweider and colleagues 
[91] found that the psychotomimetic subjective effects of psilocybin are due 
to activation of 5-HT 2A activation as these symptoms could be blocked by ket- 
anserin. Vollenweider and Geyer [92] suggest that the psychotomimetic effects 
of psilocybin can be attributed to disrupted thalamic gating of informational 
input to the cortex. 


316 


Edward F. Pace-Schott 


The SSRIs themselves can also produce hallucinosis [93, 94], particularly 
when given to persons with a compromised cholinergic system due to dementia 
or anticholinergic drugs [93], It has been hypothesized that a cholinergic-sero¬ 
tonergic imbalance characterized by cholinergic hypoactivity and serotonergic 
hyperactivity may underlie hallucinosis in response to SSRIs in such vulnerable 
individuals [93], Such an effect is strikingly similar to the cholinergic-serotoner¬ 
gic imbalance thought to underlie complex visual hallucinations in peduncu¬ 
lar hallucinosis in which midbrain neuromodulatory regions are damaged [95], 
Another indication of serotonergic involvement in dream hallucinosis is the 
fact that hallucinatory symptoms in patients with Charles Bonnet syndrome 
(complex visual hallucinosis following damage to primary visual pathways) can 
be ameliorated by a 5-HT 3 antagonist, cisapride [96], 


Possible mechanisms for SSRI dream augmentation 
and implications for normal dreaming 


A number of explanations of the dream-intensifying effects of the SSRIs are 
plausible and, given the currently limited state of knowledge on the endogenous 
neurochemistry and exogenous pharmacology of dreaming, none can be con¬ 
clusively ruled out. Before further speculating about the effects of serotonin 
on dreaming, two additional issues must be acknowledged. First, despite the 
sometimes dramatic effects of SSRIs on dreaming, it is not known if endog¬ 
enous serotonin plays an enhancing or suppressive role in normal dreaming. 
Exogenous agents may imitate or alter the endogenous neurochemistry under¬ 
lying a behavioral phenomenon without their endogenous counterparts neces¬ 
sarily playing a role in the normal expression of these phenomena. For exam¬ 
ple, the euphoriogenic effects of the abused opioids do not reflect a key role for 
the endogenous opioids in normal mood regulation. A second issue is the fact 
that not all SSRI-treated patients experience dream intensification. Based upon 
clinical-trial reports published in the 2006 Physician’s Desk Reference, despite 
being one of the most common side effects of SSRIs such as fluoxetine, the 
incidence of abnormal dreaming was reported in well below 50% of treated pa¬ 
tients. With these caveats in mind, a few explanations for SSRI-induced dream 
enhancement can be suggested. 

First, the decrease in dream frequency during SSRI treatment may reflect se¬ 
rotonergic REM suppression, while the augmented report length and bizarre¬ 
ness during acute SSRI discontinuation may reflect cholinergic rebound from 
serotonergic suppression. Such SSRI-induced REM suppression and rebound 
may occur within individual nights and/or across several nights [9], This may, in 
turn, produce periodic, intense, highly memorable dreams resulting, over time, 
in the patient’s subjective impression, reported to clinicians, that their medica¬ 
tion intensifies their dreams. For example, Thase [34] suggests that increased 
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REM phasic activity and a shifting of overall total REM time toward morn¬ 
ing awakening may result in reports of intensified dreaming during antidepres¬ 
sant therapy. Evidence for such an explanation of SSRI-enhanced dreaming 
are clinical reports that dream intensification occurs both during treatment (see 
above), as well as during the SSRI-withdrawal syndrome following discontinu¬ 
ation of short-half-life agents like paroxetine [47, 48], 

Second, enhanced global or regional brain arousal associated with amin- 
ergic stimulation may intensify dreaming in all sleep stages or particularly in 
REM. For example, despite prolonging REM latency, the SSRI fluoxetine has 
been shown to increase phasic REM activity [34], Other drugs that increase 
CNS arousal by aminergic mechanisms can also intensify dreaming. For ex¬ 
ample, intensified dreaming and nightmares are associated with l-DOPA treat¬ 
ment (reviewed in [4, 5, 97, 98]). Either the cyclic REM suppression and re¬ 
bound suggested above or REM-specific serotonergic enhancement of global 
or regional brain activity might account for the observed dissociation between 
reduced recall rate (suggesting suppressed dream initiation processes) and the 
intensification of already occurring dreaming. 

A more neurochemically specified variant of the preceding hypothesis arises 
from the behavioral pharmacology of 5-HT 2A and 5-HT 2C receptors. Excitation 
of these receptors at presynaptic sites by serotonergic hallucinogens produces 
abnormal, possibly dream-like experiences during waking, while antagonism of 
these receptors by ritanserin and ketanserin promotes SWS (reviewed above), 
an NREM state characterized by fewer, shorter and less intense dreams than 
REM (reviewed in [3, 99, 100]). It is of interest that 5-HT 2A receptors are par¬ 
ticularly concentrated in the orbitofrontal cortex (reviewed in [101]). Especially 
dense concentrations of these receptors in Brodmann Area 11 of the lateral 
orbitofrontal cortex may allow serotonin to play a regulatory role in processes 
such as reversal learning [101] and responses to negative outcomes that require 
behavioral change [102], Although the lateral prefrontal cortex (PFC) is rela¬ 
tively deactivated in REM sleep relative to waking, medial PFC regions are 
among those areas that re-activate in REM, in concert with much of the an¬ 
terior limbic subcortex, to levels comparable to waking [87, 89, 103] (reviewed 
in [2, 104, 105]). The two-way interaction between paralimbic prefrontal areas 
that are active in REM and the brainstem and basal forebrain nuclei that send 
neuromodulatory projections back to these same regions [101] provides the cir¬ 
cuitry by which 5-HT, exogenously elevated by SSRIs, can impact dreaming in 
subtle ways in addition to REM suppression-rebound phenomena. 

Third, intensified dreaming during SSRI treatment may be related to a de- 
differentiation of REM/NREM stages. Possible evidence for SSRI-induced 
breakdown of sleep architecture is the profound increase in eye movements 
during NREM sleep [14, 30, 38, 41, 45], Such de-differentiation may reflect 
an increase in REM physiological signs intruding into NREM sleep, a pheno¬ 
menon termed “covert REM sleep” by Nielsen [99, 100], Nielsen suggests that 
factors that cause such dissociated REM signs to intrude upon NREM, such 
as sleep-disruptive drugs, may elicit dream-like NREM mentation. However, 
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it is also possible that SSRI-induced NREM eye movements are unrelated to 
REM mechanisms and instead reflect alterations in the tone of brainstem ocu¬ 
lomotor pre-motor neurons [41], which may be related to a generalized SSRI 
enhancement of muscle tone during sleep [43], 

Fourth, suppressive effects of SSRIs on dream generation (via REM sup¬ 
pression) may be opposed by enhanced recall of pre-awakening mentation 
from any sleep stage either indirectly due to lightened sleep or by specifically 
serotonergic effects on memory. As a large proportion of the dreaming that has 
actually occurred during a sleep bout is forgotten, the necessary rapid transfer 
of dream memory from short to long-term storage may depend on the level of 
arousal, and this process may be impaired if arousal is low just before and/or 
after waking [106], Therefore, the co-occurrence of decreased dream recall with 
enhanced dream intensity might result from improved recall of fewer dreams. 

Of course, enhanced dream memorability by SSRI treatment may involve 
the combined and synergistic influence of several mechanisms including im¬ 
proved memory for pre-sleep mentation, a further-than-normal skew of total 
REM time toward the end of the sleep bout, and within-night REM suppres¬ 
sion and rebound. Similarly, alternate explanations for the co-occurrence of 
SSRI-induced NREM eye movements and SSRI-induced dream intensifica¬ 
tion are not mutually exclusive. A combination of increased brain activation, 
sleep stage de-differentiation and elevated peripheral EMG may all contribute 
to SSRI-induced NREM eye movements, while the former two mechanisms 
may both contribute to dream intensification. Given the multitude of phar¬ 
macological agents with dream effects [4-6], it is likely that there are diverse, 
and possibly redundant neurochemical mechanisms controlling the initiation, 
maintenance and intensity of dreaming. Notably, waking syndromes with for¬ 
mal similarities to dreaming such as delirium and complex visual hallucinosis 
(see [80]) are similarly believed to have multifactorial etiologies at the level of 
cellular neurochemistry [95, 107, 108], 

Aghajanian and Marek [82] have shown that hallucinogen-like effects at the 
synaptic level (asynchronous presynaptic glutamate release and consequent 
postsynaptic EPSPs) can be produced by 5-HT itself under conditions of de¬ 
clining or low 5-HT levels. Based upon this finding, it might be speculated that 
normal REM-sleep dreaming is facilitated by declining cortical synaptic 5-HT 
concentrations during the NREM-REM transition followed by very low levels 
in REM itself [2], Additionally, ultradian fluctuations in the relative strength 
of serotonergic versus cholinergic ascending activation may create conditions 
conducive to hallucinosis analogous to hallucinosis resulting from disruption 
of these ascending activating systems by upper brainstem lesions in peduncular 
hallucinosis [95], Therefore, tonic elevation of synaptic 5-HT levels in SSRI- 
treated patients may promote serotonergic triggering of hallucinatory expe¬ 
riences under REM-related conditions of declining or low levels of extracel¬ 
lular 5-HT at the same time as the serotonergic-cholinergic balance is changing 
with the NREM-REM transition. 
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Despite the current lack of data, the future looks bright for obtaining in¬ 
formation on the role of 5-HT in both drug-altered and normal dreaming via 
advances in human sleep pharmacology (reviewed in [32, 67, 70, 109]) as well 
as by direct observation of serotonergic drugs in the waking human brain using 
functional neuroimaging with serotonergic radioligands (e.g., [110-113]). 


References 

1 Perry E, Ashton H, Young A (2002) Neurochemistry of consciousness: Transmitters in 
mind. John Benjamins Publishing Company, Amsterdam 

2 Pace-Schott EF (2005) The neurobiology of dreaming. In: MH Kryger, T Roth, WC 
Dement (eds): Principles and practice of sleep medicine, 4th edn. Elsevier, Philadelphia, 
551-572 

3 Hobson JA, Pace-Schott EF, Stickgold R (2000) Dreaming and the brain: toward a 
cognitive neuroscience of conscious states. Behav Brain Sci 23: 793-842; discussion 
904-1121 

4 Thompson DF, Pierce DR (1999) Drug-induced nightmares. Ann Pharmacother 33: 
93-98 

5 Pagel JF, Helfter P (2003) Drug induced nightmares - An etiology based review. Hum 
Psychopharmacol 18: 59-67 

6 Pagel J (2004) Drug induced alterations in dreaming: An exploration of the dream 
data terrain outside activation-synthesis. Behav Brain Sci 27: 702-707 

7 Markowitz JC (1991) Fluoxetine and dreaming. J Clin Psychiatry 52: 432 

8 Lepkifker E, Dannon PN, Iancu I, Ziv R, Kotler M (1995) Nightmares related to 
fluoxetine treatment. Clin Neuropharmacol 18: 90-94 

9 Pace-Schott EF, Gersh T, Silvestri R, Stickgold R, Salzman C, Hobson JA (2001) SSRI 
treatment suppresses dream recall frequency but increases subjective dream intensity 
in normal subjects. J Sleep Res 10: 129-142 

10 Gottesmann C (2002) Dreaming: Monoaminergic disinhibition hypothesis. In: E Perry, 
H Ashton, A Young (eds): Neurochemistry of consciousness: Transmitters in Mind. 
John Benjamins, Amsterdam, 133-146 

11 Solms M (2002) Dreaming: cholinergic and dopaminergic hypotheses. In: E Perry, 
H Ashton, A Young (eds): Neurochemistry of consciousness: Transmitters in mind. 
John Benjamin, Amsterdam, 123-131 

12 Gottesmann C (2006) The dreaming sleep stage: a new neurobiological model of 
schizophrenia? Neuroscience 140: 1105-1115 

13 Pace-Schott EF (2003) Recent findings on the neurobiology of sleep and dreaming. In: 
EF Pace-Schott, M Solms, M Blagrove, S Harnad (eds): Sleep and dreaming: Scientific 
advances and reconsiderations. Cambridge University Press, Cambridge 

14 Pace-Schott EF, Hobson JA, Stickgold R (1994) The fluoxetine-mediated increase in 
NREM eye movements can be detected in the home setting using the Nightcap. Sleep 
Res 23: 459 

15 Armitage R, Rochlen A, Fitch T, Trivedi M, Rush J (1995) Dream recall and major 
depression: a preliminary report. Dreaming 5: 189-198 

16 Koponen H, Lepola U, Leinonen E, Jokinen R, Penttinen J, Turtonen J (1997) Citalo- 
pram in the treatment of obsessive-compulsive disorder: an open pilot study. Acta Psy- 
chiatr Scand 96: 343-346 

17 Kirschner NT (1999) Medication and dreams: Changes in dream content after drug 
treatment. Dreaming 9: 195-200 

18 Ebben M, Lequerica A, Spielman A (2002) Effects of pyridoxine on dreaming: a pre¬ 
liminary study. Percept Mot Skills 94: 135-140 


320 Edward F. Pace-Schott 

19 Devulder J, De Laat M, Dumoulin K, Renson A, Roily G (1996) Nightmares and hal¬ 
lucinations after long-term intake of tramadol combined with antidepressants. Acta 
Clin Belg 51: 184-186 

20 Radbruch L, Grand S, Lehmann KA (1996) A risk-benefit assessment of tramadol in 
the management of pain. Drug Saf 15: 8-29 

21 Neylan TC, Metzler TJ, Schoenfeld FB, Weiss DS, Lenoci M, Best SR, Lipsey TL, 
Marmar CR (2001) Fluvoxamine and sleep disturbances in posttraumatic stress disor¬ 
der. J Trauma Stress 14: 461-467 

22 Berger M, Riemann D (1993) Symposium: Normal and abnormal REM sleep regula¬ 
tion: REM sleep in depression - an overview. J Sleep Res 2:211-223 

23 Riemann D, Low H, Schredl M, Wiegand M, Dippel B, Berger M (1990) Investiga¬ 
tions of morning and laboratory dream recall and content in depressive patients dur¬ 
ing baseline conditions and under antidepressive treatment with trimipramine. Psychi- 
atr JUniv Ott 15: 93-99 

24 Antrobus JS, Schnee RK, Lynne A, Silverman SS, Offer V, Boback P (1977) Psycholin¬ 
guists coding manual for reports of sleep and stimulus independent waking state experi¬ 
ence. Educational Testing Service Princeton 

25 Maher EA (1997) Bizarrenesss and Active movement in Nightcap mentation reports: 
Implications for activation-synthesis theory: Psychology. Harvard University Exten¬ 
sion School, Boston 

26 Williams J, Merritt J, Rittenhouse C, Hobson JA (1992) Bizarreness in dreams and 
fantasies: Implications for the activation-synthesis hypothesis. Consciousness Cogni¬ 
tion 1:172-185 

27 Ajilore O, Stickgold R, Rittenhouse CD, Hobson JA (1995) Nightcap: laboratory and 
home-based evaluation of a portable sleep monitor. Psychophysiology 32: 92-98 

28 Silvestri R, Pace-Schott EF, Gersh T, Stickgold R, Salzman C, Hobson JA (2001) Ef¬ 
fects of fluvoxamine and paroxetine on sleep structure in normal subjects: a home- 
based Nightcap evaluation during drug administration and withdrawal. J Clin Psy¬ 
chiatry 62: 642-652 

29 Armitage R (1996) Effects of antidepressant treatment on sleep EEG in depression. 
J Psychopharmacol 10: 22-25 

30 Dorsey CM, Lukas SE, Cunningham SL (1996) Fluoxetine-induced sleep disturbance 
in depressed patients. Neuropsychopharmacology 14: 437-442 

31 Kupfer DJ, Perel JM, Pollock BG, Nathan RS, Grochocinski VJ, Wilson MJ, 
McEachran AB (1991) Fluvoxamine versus desipramine: comparative polysomno- 
graphic effects. Biol Psychiatry 29: 23-40 

32 Mayers AG, Baldwin DS (2005) Antidepressants and their effect on sleep. Hum Psy¬ 
chopharmacol 20: 533-559 

33 Oberndorfer S, Saletu-Zyhlarz G, Saletu B (2000) Effects of selective serotonin reup¬ 
take inhibitors on objective and subjective sleep quality. Neuropsychobiology 42: 69- 
81 

34 Thase ME (1998) Depression, sleep, and antidepressants. J Clin Psychiatry 59 Suppl 4: 
55-65 

35 Oswald I, Adam K (1986) Effects of paroxetine on human sleep. Br J Clin Pharmacol 
22: 97-99 

36 Saletu B, Frey R, Krupka M, Anderer P, Grunberger J, See WR (1991) Sleep labora¬ 
tory studies on the single-dose effects of serotonin reuptake inhibitors paroxetine and 
fluoxetine on human sleep and awakening qualities. Sleep 14: 439-447 

37 Armitage R, Trivedi M, Rush J, Hoffman R (1995) The effects of fluoxetine on period- 
analyzed sleep EEG in depression. Sleep Res 24: 381 

38 Armitage R, Trivedi M, Rush AJ (1995) Fluoxetine and oculomotor activity during 
sleep in depressed patients. Neuropsychopharmacology 12: 159-165 



Serotonin and dreaming 


321 


39 Hendrickse WA, Roffwarg HP, Grannemann BD, Orsulak PJ, Armitage R, Cain JW, 
Battaglia J, Debus JR, Rush AJ (1994) The effects of fluoxetine on the polysomno- 
gram of depressed outpatients: a pilot study. Neuropsychopharmacology 10: 85-91 

40 Dorsey CM, Lukas SE, Cunningham SL, Richardson GS, Winkelman JW (1992) In¬ 
creased risk of periodic leg movements during sleep with use of fluoxetine. Sleep Res 
21:56 

41 Schenck CH, Mahowald MW, Kim SW, O’Connor KA, Hurwitz TD (1992) Promi¬ 
nent eye movements during NREM sleep and REM sleep behavior disorder associated 
with fluoxetine treatment of depression and obsessive-compulsive disorder. Sleep 15: 
226-235 

42 Ellison JM, Stanziani P (1993) SSRI-associated nocturnal bruxism in four patients. 
J Clin Psychiatry 54: 432-434 

43 Armitage R, Trivedi M, Rush J, Pechacek P, Cole D, Dunnam D (1994) Effects of 
fluoxetine on EOG and EMG activity during sleep in depression. Sleep Res 23: 61 

44 Dorsey CM, Cunningham SL, Lukas SE, Winkelman JW, Richardson GS, Jones K 
(1992) Fluoxetine-induced eye movements during non-REM sleep. Sleep Res 21: 55 

45 Geyer JD, Carney PR, J. P, Parrish P (2006) Anti-depressant medications, neuroleptics 
and prominent eye movements during NREM sleep. Sleep 29: A34 

46 Gagnon JF, Postuma RB, Montplaisir J (2006) Update on the pharmacology of REM 
sleep behavior disorder. Neurology 67: 742-747 

47 Coupland NJ, Bell CJ, Potokar JP (1996) Serotonin reuptake inhibitor withdrawal. 
J Clin Psychopharmacol 16: 356-362 

48 Dilsaver SC (1994) Withdrawal phenomena associated with antidepressant and anti¬ 
psychotic agents. Drug Saf 10: 103-114 

49 Trivedi MH, Rush AJ, Armitage R, Gullion CM, Grannemann BD, Orsulak PJ, Roff¬ 
warg HP (1999) Effects of fluoxetine on the polysomnogram in outpatients with major 
depression. Neuropsychopharmacology 20: 447-459 

50 DeVane CL (1992) Pharmacokinetics of the selective serotonin reuptake inhibi¬ 
tors. J Clin Psychiatry 53 Suppl: 13-20 

51 Manfridi RL, Kales A (1987) Clinical neuropharmacology of sleep disorders. Semin 
Neurol 7: 286-295 

52 McCarley RW, Hobson JA (1975) Neuronal excitability modulation over the sleep 
cycle: a structural and mathematical model. Science 189: 58-60 

53 Berger M, Riemann D, Hochli D, Spiegel R (1989) The cholinergic rapid eye move¬ 
ment sleep induction test with RS-86. State or trait marker of depression? Arch Gen 
Psychiatry 46: 421-428 

54 Gillin JC, Sutton L, Ruiz C, Kelsoe J, Dupont RM, Darko D, Risch SC, Golshan S, 
Janowsky D (1991) The cholinergic rapid eye movement induction test with arecoline 
in depression. Arch Gen Psychiatry 48: 264-270 

55 Sitaram N, Moore AM, Gillin JC (1978) Experimental acceleration and slowing of 
REM sleep ultradian rhythm by cholinergic agonist and antagonist. Nature 274: 490- 
492 

56 Sitaram N, Wyatt RJ, Dawson S, Gillin JC (1976) REM sleep induction by physostig- 
mine infusion during sleep. Science 191: 1281-1283 

57 Sitaram N, Moore AM, Gillin JC (1978) The effect of physostigmine on normal hu¬ 
man sleep and dreaming. Arch Gen Psychiatry 35: 1239-1243 

58 Vogel GW, Buffenstein A, Minter K, Hennessey A (1990) Drug effects on REM sleep 
and on endogenous depression. Neurosci Biobehav Rev 14: 49-63 

59 Sharpley AL, Cowen PJ (1995) Effect of pharmacologic treatments on the sleep of 
depressed patients. Biol Psychiatry 37: 85-98 

60 Hobson JA, McCarley RW (1977) The brain as a dream state generator: an activation- 
synthesis hypothesis of the dream process. Am J Psychiatry 134: 1335-1348 

61 Page F, Coleman G, Conduit R (2006) The effect of transdermal nicotine patches on 
sleep and dreams. Physiol Behav 88: 425-432 


322 


Edward F. Pace-Schott 


62 Lam S, Patel PN (2007) Varenicline: a selective alpha4beta2 nicotinic acetylcholine 
receptor partial agonist approved for smoking cessation. Cardiol Rev 15: 154-161 

63 Kitabayashi Y, Ueda H, Tsuchida H, Yamashita T, Narumoto J, Fukui K (2006) 
Donepezil-induced nightmares in mild cognitive impairment. Psychiatry Clin Neurosci 
60: 123-124 

64 Ross JS, Shua-Haim JR (1998) Aricept-induced nightmares in Alzheimer’s disease: 
2 case reports. J Am Geriatr Soc 46: 119-120 

65 Singer M, Romero B, Koenig E, Forstl H, Brunner H (2005) [Nightmares in patients 
with Alzheimer’s disease caused by donepezil. Therapeutic effect depends on the time 
of intake], NervenarztK, : 1127-1128, 1129 

66 Yamada Y, Shibuya F, Hamada J, Sawada Y, Iga T (1995) Prediction of sleep disorders 
induced by beta-adrenergic receptor blocking agents based on receptor occupancy. 
J Pharmacokinet Biopharm 23: 131-145 

67 Adrien J (2002) Neurobiological bases for the relation between sleep and depression. 
Sleep Med Rev 6: 341-351 

68 Landolt HP, de Boer LP (2001) Effect of chronic phenelzine treatment on REM sleep: 
report of three patients. Neuropsychopharmacology 25: S63-67 

69 Landolt HP, Raimo EB, Schnierow BJ, Kelsoe JR, Rapaport MH, Gillin JC (2001) 
Sleep and sleep electroencephalogram in depressed patients treated with phenelzine. 
Arch Gen Psychiatry 58: 268-276 

70 Wilson S, Argyropoulos S (2005) Antidepressants and sleep: a qualitative review of the 
literature. Drugs 65: 927-947 

71 Adam K, Oswald I (1989) Effects of repeated ritanserin on middle-aged poor sleepers. 
Psychopharmacology (Berl) 99: 219-221 

72 Idzikowski C, Mills FJ, James RJ (1991) A dose-response study examining the effects 
of ritanserin on human slow wave sleep. Br J Clin Pharmacol 31: 193-196 

73 Idzikowski C, Mills FJ, Glennard R (1986) 5-Hydroxytryptamine-2 antagonist in¬ 
creases human slow wave sleep. Brain Res 378: 164-168 

74 Mayer G (2003) Ritanserin improves sleep quality in narcolepsy. Pharmacopsychiatry 
36: 150-155 

75 Monti JM (1987) Disturbances of sleep and wakefulness associated with the use of 
antihypertensive agents. Life Sci 41:1979-1988 

76 Sharpley AL, Elliott JM, Attenburrow MJ, Cowen PJ (1994) Slow wave sleep in hu¬ 
mans: role of 5-HT 2A and 5-HT 2C receptors. Neuropharmacology 33: 467^471 

77 Sharpley AL, Solomon RA, Fernando AI, da Roza Davis JM, Cowen PJ (1990) Dose- 
related effects of selective 5-HT 2 receptor antagonists on slow wave sleep in humans. 
Psychopharmacology (Berl) 101: 568-569 

78 van Laar M, Volkerts E, Verbaten M (2001) Subchronic effects of the GABA-agonist 
lorazepam and the 5-HT 2A(2C antagonist ritanserin on driving performance, slow wave 
sleep and daytime sleepiness in healthy volunteers. Psychopharmacology (Berl) 154: 
189-197 

79 Landolt HP, Meier V, Burgess HJ, Finelli LA, Cattelin F, Achermann P, Borbely AA 
(1999) Serotonin-2 receptors and human sleep: effect of a selective antagonist on EEG 
power spectra. Neuropsychopharmacology 21: 455-466 

80 Hobson JA (1999) Dreaming as delirium. MIT Press, Cambridge 

81 Hobson JA (2001) The dream drug store. MIT Press, Cambridge 

82 Aghajanian GK, Marek GJ (1999) Serotonin and hallucinogens. Neuropsychopharma¬ 
cology 21: 16S-23S 

83 Derry C, Benjamin C, Bladin P, le Bars D, Tochon-Danguy H, Berkovic SF, Zimmer 
L, Costes N, Mulligan R, Reutens D (2006) Increased serotonin receptor availability 
in human sleep: evidence from an [ 1S F]MPPF PET study in narcolepsy. Neuroimage 30: 
341-348 


Serotonin and dreaming 


323 


84 Zeitzer JM, Maidment NT, Behnke EJ, Ackerson LC, Fried I, Engel J Jr, Wilson CL 
(2002) Ultradian sleep-cycle variation of serotonin in the human lateral ventricle. Neu¬ 
rology 59:1272-1274 

85 Hasler F, Grimberg U, Benz MA, Huber T, Vollenweider FX (2004) Acute psychologi¬ 
cal and physiological effects of psilocybin in healthy humans: a double-blind, placebo- 
controlled dose-effect study. Psychopharmacology (Berl) 172: 145-156 

86 Vollenweider FX, Leenders KL, Scharfetter C, Maguire P, Stadelmann O, Angst J 
(1997) Positron emission tomography and fluorodeoxyglucose studies of metabolic 
hyperfrontality and psychopathology in the psilocybin model of psychosis. Neuropsy¬ 
chopharmacology 16: 357-372 

87 Nofzinger EA, Mintun MA, Wiseman M, Kupfer DJ, Moore RY (1997) Forebrain 
activation in REM sleep: an FDG PET study. Brain Res 770: 192-201 

88 Maquet P, Peters J, Aerts J, Delfiore G, Degueldre C, Luxen A, Franck G (1996) Func¬ 
tional neuroanatomy of human rapid-eye-movement sleep and dreaming. Nature 383: 
163-166 

89 Braun AR, Balkin TJ, Wesenten NJ, Carson RE, Varga M, Baldwin P, Selbie S, Belenky 
G, Herscovitch P (1997) Regional cerebral blood flow throughout the sleep-wake cycle. 
An H 2 1s O PET study. Brain 120: 1173-1197 

90 Braun AR, Balkin TJ, Wesensten NJ, Gwadry F, Carson RE, Varga M, Baldwin P, 
Belenky G, Herscovitch P (1998) Dissociated pattern of activity in visual cortices and 
their projections during human rapid eye movement sleep. Science 279: 91-95 

91 Vollenweider FX, Vollenweider-Scherpenhuyzen MF, Babler A, Vogel H, Hell D 
(1998) Psilocybin induces schizophrenia-like psychosis in humans via a serotonin-2 
agonist action. Neuroreport 9: 3897-3902 

92 Vollenweider FX, Geyer MA (2001) A systems model of altered consciousness: inte¬ 
grating natural and drug-induced psychoses. Brain Res Bull 56: 495-507 

93 Cancelli I, Marcon G, Balestrieri M (2004) Factors associated with complex visual 
hallucinations during antidepressant treatment. Hum Psychopharmacol 19: 577-584 

94 Kumagai R, Ohnuma T, Nagata T, Arai H (2003) Visual and auditory hallucinations 
with excessive intake of paroxetine. Psychiatry Clin Neurosci 57: 548-549 

95 Manford M, Andermann F (1998) Complex visual hallucinations. Clinical and neuro- 
biological insights. Brain 121: 1819-1840 

96 Ranen NG, Pasternak RE, Rovner BW (1999) Cisapride in the treatment of visual 
hallucinations caused by vision loss: The Charles Bonnet syndrome. Am J Geriatr Psy¬ 
chiatry 7: 264—266 

97 Hobson JA, Pace-Schott EF (1999) Reply to Solms, Braun and Reiser. Neuropsycho¬ 
analysis 1: 206-224 

98 Solms M (1997) The neuropsychology of dreams: A clinico-anatomical study. Lawrence 
Erlbaum Associates, Mahwah 

99 Nielsen TA (1999) Mentation during sleep: The NREM/REM distinction. In: R Lydic, 
H Baghdoyan (eds): Handbook of behavioral state control: Molecular and cellular 
mechanisms. CRC Press, Boca Raton, 101-128 

100 Nielsen TA (2000) A review of mentation in REM and NREM sleep: “covert” REM 
sleep as a possible reconciliation of two opposing models. Behav Brain Sci 23: 851— 
866; discussion 904-1121 

101 Robbins TW, Clark L, Clarke H, Roberts AC (2006) Neurochemical modulation of 
orbitfrontal cortex function. In: DH Zald, SL Rauch (eds): The Orbitofrontal Cortex. 
Oxford University Press, Oxford, 393-422 

102 Korte SM, Koolhaas JM, Wingfield JC, McEwen BS (2005) The Darwinian concept 
of stress: Benefits of allostasis and costs of allostatic load and the trade-offs in health 
and disease. Neurosci Biobehav Rev 29: 3-38 

103 Nofzinger EA, Buysse DJ, Germain A, Carter C, Luna B, Price JC, Meltzer CC, 
Miewald JM, Reynolds CF 3rd, Kupfer DJ (2004) Increased activation of anterior 


324 Edward F. Pace-Schott 

paralimbic and executive cortex from waking to rapid eye movement sleep in depres¬ 
sion. Arch Gen Psychiatry 61: 695-702 

104 Maquet P, Ruby P, Maudoux A, Albouy G, Sterpenich V, Dang-Vu T, Desseilles M, 
Boly M, Perrin F, Peigneux P et al (2005) Human cognition during REM sleep and the 
activity profile within frontal and parietal cortices: a reappraisal of functional neuro¬ 
imaging data. Prog Brain Res 150: 219-227 

105 Pace-Schott EF (2007) The frontal lobes and dreaming. In: D Barrett, P McNamara 
(eds): The new science of dreaming. Praeger, Greenwood Press, Westport, 115-154 

106 Goodenough DR (1991) Dream recall: history and current status of the field. In: SJ 
Ellman, JS Antrobus (eds): The mind in sleep. Wiley, New York, 143-171 

107 Trzepacz PT (2000) Is there a final common neural pathway in delirium? Focus on 
acetylcholine and dopamine. Semin Clin Neuropsychiatry 5: 132-148 

108 Ashton H (2002) Delirium and hallucinations. In: E Perry, H Ashton, A Young (eds): 
Neurochemistry of consciousness: transmitters in mind. John Benjamin, Amsterdam, 
181-203 

109 Dugovic C (2001) Role of serotonin in sleep mechanisms. Rev Neurol (Paris) 157: 
S16—19 

110 Erlandsson K, Sivananthan T, Lui D, Spezzi A, Townsend CE, Mu S, Lucas R, War¬ 
rington S, Ell PJ (2005) Measuring SSRI occupancy of SERT using the novel tracer 
pljADAM: a SPECT validation study. Eur J Nucl Med Mol Imaging 32: 1329-1336 

111 Klein N, Sacher J, Geiss-Granadia T, Attarbaschi T, Mossaheb N, Lanzenberger R, 
Potzi C, Holik A, Spindelegger C, Asenbaum S et al (2006) In vivo imaging of sero¬ 
tonin transporter occupancy by means of SPECT and [ 123 I]ADAM in healthy sub¬ 
jects administered different doses of escitalopram or citalopram. Psychopharmacology 
(Berl) 188: 263-272 

112 Ogden RT, Ojha A, Erlandsson K, Oquendo MA, Mann JJ, Parsey RV (2007) In vivo 
quantification of serotonin transporters using [(11)C]DASB and positron emission 
tomography in humans: modeling considerations. J Cereb Blood Flow Metab 27: 205- 
217 

113 Parsey RV, Ojha A, Ogden RT, Erlandsson K, Kumar D, Landgrebe M, Van Heertum 
R, Mann JJ (2006) Metabolite considerations in the in vivo quantification of serotonin 
transporters using U C-DASB and PET in humans. / Nucl Med 47: 1796-1802 


Serotonin and Sleep: Molecular, Functional and Clinical Aspects 
Edited by J.M. Monti, S.R. Pandi-Perumal, B.L. Jacobs and D.J. Nutt 
© 2008 Birkhauser Verlag/Switzerland 


Involvement of the 5-HT 1A and the 5-HT 1B receptor 
in the regulation of sleep and waking 


Chiara M. Portas and Janne Granli 

Department of Biomedicine, University of Bergen, Jonas Lies vei 91, 
5009 Bergen, Norway 


Abstract 

The involvement of the 5-HT 1A and the 5-HT 1B receptor in the regulation of sleep and wak¬ 
ing is complex due to a multitude of presynaptic and/or postsynaptic actions also involving 
other neurotransmitter systems. Both receptors produce an important inhibitory feed back 
to the serotonergic raphe neurons. Overall, most studies support the possibility that stimu¬ 
lation of postsynaptic 5-HT 1A receptors, e.g., via systemic administration of a high dose 
of agonists increases wakefulness and decreases sleep. Local administration of agonists in 
dorsal raphe nucleus mainly produces a response similar to the “low-dose” systemic ad¬ 
ministration, decreasing wakefulness and increasing rapid eye movement (REM) sleep via 
disinhibition of mesopontine REM sleep promoting neurons. Systemic administration of 
5-E1 T 1b receptors agonists consistently increases wakefulness and decreases REM sleep, as 
do the 5-HT 1A agonists. The mechanism by which 5-HT 1B receptors affect state modulation 
remain elusive. The general arousing effects of 5-EIT 1A and 5-EIT 1B agonists should also be 
considered in relation to the multiple, largely redundant, neurotransmitter systems that 
maintain arousal. Finally, 5-HT 1A and 5-EIT 1B receptor are important modulators of the 
circadian rhythm largely by affecting the response of the suprachiasmatic nucleus to light 
and the secretion of melatonin from the pineal gland. The development of more selective 
ligands seems crucial to further explore the role of these receptors in state modulation. 


Introduction 

The multiple and highly differentiated function of the 5-hydroxytryptamine 
(5-HT, serotonin) receptors continue to surprise the scientific community. As 
soon as one believes to have reached some understanding, the picture becomes 
much more complicated because more receptors or more modalities of action 
are identified. 
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The serotonergic receptors are a big class of mostly metabotrophic G pro¬ 
tein-coupled receptors (with the exception of the subgroup 5-HT 3 receptors). 
Today, 7 subclasses are found, and 14 receptor sub-types are identified [1], but 
the family is likely to expand further. This means that the effect of serotonin 
output in the brain largely depends on “where about” more than on the quan¬ 
tity released. In this chapter only two subgroups of the 5-HT, receptors family, 
the 5-HT 1A and the 5-HT 1B , are discussed in relation to their involvement in 
sleep and waking. 


5-HTj receptors family 

The 5-HTj receptors family was not originally associated with state modula¬ 
tion. 5-HT! receptors were differentiated from 5-HT 2 receptors because of a 
higher binding of [ 3 H]5-HT [2], Two years later Pedigo and collaborators dis¬ 
tinguished two populations of equal high affinity binding sites for [ 3 H]5-HT on 
the basis of their different affinity to spiperone [3], These receptors were named 
5-HT 1A (high affinity for spiperone) and 5-HT 1B (low affinity). In the follow¬ 
ing three decades these two receptor subtypes have been extensively studied in 
relation to complex behaviors. Other subgroups of the 5-HTj receptors family 
were eventually identified on the basis of different biochemical and pharmaco¬ 
logical characteristics, and have been termed 5-HT 1D , 5-HT 1E and 5-HT 1F . The 
5-HTi C receptor widely accepted as a 5-HT 2 receptor subtype, is also referred 
to as the 5-HT 2C site [4], The role of these receptors in state modulation are not 
discussed in this context. 


Characteristics of the 5-HT 1A receptors 

5-HT 1A receptors are G protein-coupled receptors and such interaction pro¬ 
duces inhibition of adenylcyclase modulating ionic channels (e.g., potassium 
and/or calcium) [5], Enhanced K + conductance leads to membrane hyperpolari¬ 
zation explaining the usual inhibitory nature of 5-HT 1A activation [6]. 


Localization 

The 5-HT 1A receptors are widely distributed in the central nervous system 
(CNS). Higher density of 5-HT 1A receptors has been observed in the hippo¬ 
campus, midbrain raphe region and neocortex in rodents and humans [7, 8], 
Lower density is reported in the amygdala septum and claustrum and mini¬ 
mal presence in other brain areas and brainstem [8], It is well established that 
5-HT 1A receptors can be localized both pre- or postsynaptically, and it has been 
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suggested that pre- and postsynaptic responses are mediated by different signal 
systems [9], 


The function of 5-HT 1A receptors 

The presynaptic function of the 5-HT 1A receptors has been largely studied in 
the dorsal raphe nucleus (DRN) a midbrain nucleus representing the largest 
concentration of serotonergic neurons in the CNS. Here, 5-HT 1A receptors act 
as autoreceptors [10]. Activation of these presynaptic autoreceptors produces a 
series of events leading to decreased serotonergic neurotransmission (feed-back 
mechanism). 

Postsynaptically, 5-HT 1A receptors are found on multiple serotonergic targets 
in the forebrain and brainstem [7, 8], Consequently, the effects due to activation 
of 5 -HT ia receptors mainly depend on their localization. This also explains the 
involvement of this receptor in a variety of functions including aggression [11], 
anxiety [12, 13], depression [14], feeding [15-17], alcohol intake [18], hormone 
secretion [19, 20], temperature regulation [21], micturition [22], sexual behavior 
[23] and state modulation. The latter is extensively reviewed in this chapter. 


Role of 5-HT 1A receptors on serotonergic neurons firing and 5-HT release 

Local activation of presynaptic receptors by application of 5-HT 1A agonists into 
DRN reduces serotonergic cell firing in vivo [24-26] and in vitro [27-29], Lo¬ 
cal application of the 5-HT 1A agonist 8-hydroxy-2-(di-n-propylamino)tetralin 
(8-OH-DPAT) into the DRN, also decreases the local level of extracellular se¬ 
rotonin (10 pM microdialysis perfusion) [30] and the level in a main projection 
site, the hippocampus (0.5, 1.0 and 2.0 pg microinjection) [31], Vice versa, ap¬ 
plication of a 5-HT 1A selective antagonist in the DRN {e.g., p-4-iodo-A-[2- 
[4-(methoxyphenyl)-l-piperazinyl]ethyl]-/V-2-pyridinyl-benzamide (p-MPPI), 
10 pM microdialysis perfusion} increases the local level of extracellular sero¬ 
tonin [32], 

Given systemically, the effect of the agonists and antagonists differs depend¬ 
ing on the dose administered. It has been claimed that low doses may have a 
prevalent action on the very sensitive autoreceptors, whereas high doses reach 
the widespread postsynaptic sites producing a cascade of events [33, 34], This 
possibility is further explored below. 


Direct and indirect effects mediated by 5-HT 1A receptors 

It should be considered that modulation of the serotonergic output does not 
depend uniquely on activation of presynaptic 5-HT 1A autoreceptors but on 
other factors as well. Interesting candidate are the postsynaptic 5-HT 1A recep- 
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tors [35], For example, transection of different regions of prefrontal cortex at¬ 
tenuates the inhibition of 5-FIT neurons produced by systemic but not local 
administration of 5-HT 1A agonists [36], This implies that the inhibitory effect 
of 5-HT 1A agonists on DRN firing is at least in part mediated by activation of 
5-HT 1A postsynaptic feed-back from the prefrontal cortex [36], Excitation of 
neurons of the medial prefrontal cortex by 8-OH-DPAT via 5-HT 1A receptors 
has been observed depending on dosage administered [37], A direct inhibitory 
projection from the medial prefrontal cortex to the DRN 5-FIT neurons has 
been shown [36], Such inhibition may be mediated by glutamatergic cortical 
projection neurons synapsing on y-aminohydroxy acid (GABA) neurons in the 
DRN [38], Celada and colleagues [39] identified in the medial prefrontal cortex 
projection neurons from the DRN by antidromic stimulation. Electrical stimu¬ 
lation of these neurons inhibited the activity of dorsal raphe 5-FIT neurons and 
the administration of the 5-HT 1A antagonist WAY 100635, and the GABA a an¬ 
tagonist picrotoxin partly reversed this inhibition, indicating the involvement 
of these receptors. 

However, it remains to explain how activation of cortical 5-HT 1A receptors, 
inhibitory in nature, may produce excitation of prefrontal neurons (e.g., glu¬ 
tamatergic) and the reentrant feed-back. A possibility is that the postsynaptic 
5-HT 1A receptors act on interneurons or on serotonergic, dopaminergic, norad¬ 
renergic and cholinergic terminals affecting the final output of these systems on 
cortical neurons [40-44], It appears that stimulation of 5-HT 1A receptors in the 
frontal cortex suppresses serotonin, yet facilitates noradrenaline and dopamine 
release. However, such an effect is more often mediated by 5-HT 2 receptors [45], 
The effect of 5-HT 1A agonists on acetylcholine (ACh) release is usually excita¬ 
tory [43,44], but also no changes have been reported [46], 


Role of 5-HT 1A receptors in state modulation 

Since the spontaneous firing of DRN serotonergic neurons and the local level 
of extracellular serotonin changes as a function of the behavioral state (higher 
in wakefulness (W), lower in slow-wave sleep (SWS) and lowest during rapid 
eye movement (REM) sleep [47-52], a causality effect has been suggested. 
As a consequence, manipulation of DRN serotonergic activity should affect 
behavioral state. Many studies have explored this possibility by increasing or 
decreasing DRN activity. According to this hypothesis, an increase in DRN 
serotonergic activity should correspond to an increase in wakefulness (in terms 
of total time or number of awakenings), whereas a reduction in DRN seroto¬ 
nergic activity should promote an increase in SWS and REM sleep [53], DRN 
neurons’ activity is influenced by several modulatory systems as proved by the 
presence of dopamine, glutamate, GABA, neuropeptides, p-endorphin input 
to the DRN [6]. However, the simplest approach to modulate DRN serotoner¬ 
gic activity is provided by the use of 5-HT 1A ligands. Hence, the story of sero¬ 
tonin-related state modulation is largely linked to the development of selective 
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Fig. 1 Receptor affinities of 5-HT, receptor ligands. Concentrations over which effective 
activation for agonists (a) or blockade for antagonists (b) occurs at 5-HT 1A (shown in 
dark grey), 5-HT 1B (shown in black) and 5-HT 1D (shown in light grey) receptors. Thus, 
8-OH-DPAT stimulates 5-HT 1A receptors effectively at concentrations of 10 nM and be¬ 
low, but only stimulates 5-HT 1D receptors at 1000 nM and above. Similarly, WAY 100635 
block 5-HT 1A receptors at a concentration between 1 and 10 nM, but does not antago¬ 
nize 5-HT 1B receptors unless ~100-fold higher concentrations are used. Isamoltane is an 
agonist at 5-HT 1A receptors and WAY 100135 is a partial agonist at 5-HT 1B receptors. 
The values are derived from the approximate affinities of agonists (pKi) and antagonists 
(pA2, pKB) in the literature and, in most cases, reflect an average of data from several 
sources. This figure has been reproduced with permission from [279], Elsevier Copy¬ 
right, 2000. 
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5-HT 1A agonists and antagonists. Early work based on the use of non-selective 
agents [e.g., pindolol, a mixed (3-(l/2)-adrenoceptor/5-HT receptor blocker, spi¬ 
perone, etc.] is not included in this chapter because such findings have brought 
about confusion more than understanding. Only the most selective agents are 
taken into account. It should, however, be considered that complete selectivity 
has not been shown by any compound known. Fig. 1 summarizes the affinity 
of some of the most used ligands for 5-HT 1A and 5-HT 1B receptors. 


Effects of systemic administration of 5-HT 1A agonists 
and antagonists on state 

A large body of evidence was collected after the introduction of the more se¬ 
lective 5-HT 1A agonist, 8-OH-DPAT [54] (Fig. 1). It was shown that systemic 
administration of 8-OH-DPAT at doses above 0.1 mg/kg and up to 2 mg/kg 
consistently increases waking [55-61], reduces SWS [56-61] and REM sleep 
[56-62] (Tab. la). In one study a delayed but pronounced increase in deep SWS 
has been shown 2 h after administration of 8-OH-DPAT, possibly represent¬ 
ing a rebound effect prompted by prior extended wakefulness [61]. Increased 
wakefulness and decreased SWS and REM sleep are also observed after sys¬ 
temic administration of high doses of partial 5-HT 1A agonists, e.g., gepirone 
[63], buspirone [63, 64], and ipsapirone [63, 65] (Tab. la). The latter has also 
been shown to decrease REM sleep in humans [66-68], 


Table la Effects of the systemic administration of 5-HT 1A agonists. 


Authors 

Drug 

Dose 

Effect 

Lerman et 
al. [64] 

Buspirone, 

3 and 10 mg/kg i.p. 

Increased total wake time at both doses 
and decreased SWS and REM sleep at 
the highest dose 

De St Hi- 

laire-Kafi et 
al. [55] 

S-OH-DPAT 

(0.03, 0.1, 

0.3 mg/kg sc) 

Increased W at the highest dose, 
increased REM sleep latency at any 
dosage, decreased number of awaken¬ 
ings at lowest two doses 

Monti 
et al. [56] 

S-OH-DPAT 

(0.12, 0.25, 0.5 mg/kg 
ip) 

Increased W decreased SWS and REM 
at the highest dose increased W and 
decreased REM sleep at the intermedi¬ 
ate dose decreased REM sleep even at 
the lowest dose increased REM sleep 
latency at any dosage. 
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Table la (continued) Effects of the systemic administration of 5-HT 1A agonists. 
Authors Drug Dose Effect 


Dzoljic 
etal. [57] 


Monti and 
Jantos [58] 


et al. [65] 


Monti 
etal. [63] 


8-OH-DPAT (0.5, 1, 2 mg /kg sc) 


(0.01, 0.025, 0.1, 
0.375 mg/kg sc) 


Ipsapirone (1,3 and 5 mg/kg ip) 


Monti and 
Jantos [59] 

Monti et al. 
[60] 


Buspirone 

Ipsapirone, 

Gepirone 


0.375 mg/kg sc in rats 
0.01, 0.375 mg/kg sc 


0.01-4.0mg /kg sc. 
0.01, 0.25,2 and 6 mg 
/kg sc 

0.025, 0.1,2,4 mg 
/kg sc. 


Bjorvatn 
et al. [61] 

Boutrel 
et al. [62] 

Monti and 
Jantos [101] 


8-OH-DPAT 0.01, 0.375 mg/kg sc 


8-OH-DPAT 0.25-1 mg/kg, s.i 


0.015, 0.03, 0.06 
pmol/kg s.c. 


Increased W and decreased SWS at 
any dosage, whereas REM sleep was 
decreased only for the highest dose. 
Similarly REM sleep latency was 
increased at the highest dose 

Increased W and decreased SWS and 
REM sleep at the highest two doses 
whereas at the lowest dose decreased 
W and increased SWS (biphasic effect 
hypothesis) postsynaptic mechanism 
(destruction of 5-HT soma did not 
change the effect) 

Increased W and decreased REM sleep 
in the first hours of recording followed 
by a rebound effect. Dose-related re¬ 
duction of REM sleep. Possibly, post¬ 
synaptic mechanism (destruction of 
5-HT soma did not change the effect) 

Increased W and decreased SWS and 
REM sleep 

Increased wakefulness and decreased 
SWS at the highest dose and decreased 
W and increased SWS at the lowest 
dose REM sleep was suppressed ir¬ 
respective of the dosage given 

All these compounds increased W and 
decreased SWS and REM sleep at the 
highest dose during the first 2 h after 
drug administration. W also increased 
at lower doses 

At the high dose increased W, reduced 
SWS and REM, at the lower dose there 
was no significant effect on sleep 

Decreased REM sleep (wild-type mice) 

Increased W and sleep latencies and 
reduced REM sleep at the highest dose 
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A more recent ligand, flesinoxan, is a potent and selective 5-HT 1A agonist 
with high affinity for brain 5-HT 1A receptors similar to that of 8-OH-DPAT 
[69-71], Flesinoxan increases wakefulness and reduces REM sleep at doses 
ranging between 0.03 and 0.06 pmol/kg s.c. [72], Thus, overall, it seems that 
systemic administration of 5-HT IA agonists increases wakefulness and reduces 
sleep, an effect more pronounced in the early hours after the injection. This 
effect is more consistent with high doses. It has been suggested that low doses 
of these agonists may act predominantly presynaptically, whereas higher doses 
would have wider reach producing extensive stimulation of postsynaptic 5-HT 1A 
receptors [33, 34], As a consequence, a biphasic behavioral effect can be ob¬ 
served after administration of 5-HT 1A receptors ligands [55, 58], De St. Hilaire- 
Kafi and collaborators [55] showed that a high dose of 8-OH-DPAT (0.3 mg/kg 
s.c.) produces a significant increase of wakefulness and REM sleep latency and 
a concomitant decrease of SWS and REM sleep, whereas low doses (0.03 and 
0.1 mg/kg s.c.) produced a tendency towards a decrease of wakefulness (Fig. 2). 
Similarly, Monti and collaborators [60] showed that a low dose (0.01 mg/kg s.c.) 
of 8-OH-DPAT decreased wakefulness and increased SWS, whereas at high 
dosage (0.1 and 0.375 mg/kg s.c.) increased wakefulness and decreased SWS 
and REM sleep. SWS latency increases at high dosage (0.375 mg/kg s.c.) [58] 
and (0.5 mg/kg i.p.) [56], whereas REM sleep latency increases even at lower 
doses (e.g., from 0.1 mg/kg) [56, 58] (Tab. la). 

The possibility that high dosage (e.g., 0.375 mg/kg s.c.) of the 5-HT 1A ago¬ 
nist 8-OH-DPAT shifts the outcome in favor of a postsynaptic action is also 
supported by a study showing that destruction of 5-HT soma does not change 
such effect [58], Similarly, toxic lesion of the DRN does not affect the action of 
another 5-HT 1A agonist, ipsapirone [65], 

These findings are overall consistent with the hypothesis of serotonergic 
contribution to state-modulation [53, 73], The degree of serotonergic activa¬ 
tion would affect state in multiple ways. First, extensive postsynaptic 5-HT 1A 
receptors activation is consistent with increased wakefulness since higher sero¬ 
tonergic activity is usually associated with arousal [47-50, 74], During waking, 
the serotonergic projections to the basal forebrain [75] may reinforce the de¬ 
synchronizing activity (low voltage fast electrocorticographic activity) of local 
neurons as a consequence of cholinergic and serotonergic stimulation [76], This 
effect appears mediated via an inhibitory influence of local GABAergic neu¬ 
rons [77], Furthermore, in vitro studies suggest that serotonin promotes arousal 
by shifting the activity of cortical and thalamic neurons from periodic and 
rhythmic spike bursts (typically observed during SWS in vivo) to tonic firing of 
single spike mode (characteristic of wakefulness and REM sleep in vivo) [78], 
Such a possibility is supported by the evidence of putative serotonergic brain¬ 
stem projections to thalamic nuclei [79], Also, 5-HT 1A agonists act as antago¬ 
nists at presynaptic a2-adreno autoreceptors possibly stimulating the release 
of noradrenaline [80], a neurotransmitter strongly associated with arousal [81]. 
It should, however, be considered that the function of the serotonergic projec- 
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Fig. 2 The figure illustrates the biphasic effect of 8-OH-DPAT at low and high concen¬ 
trations. Wakefulness is largely increased at a dose of 300 pg/kg. However, at the lowest 
dose a trend towards decrease is present. This figure has been reproduced with permis¬ 
sion from [55], 


tions to the cortex remains ambiguous, since 5-HT action on cortical neurons is 
often inhibitory [81], in contrast with the waking-specific activity of the DRN 
5-HT neurons. For example, it has been shown that serotonin inhibits the excit¬ 
ability of stellate and pyramidal neurons in the entorhinal cortex via activation 
of 5-HT 1A receptors [82], However, as mentioned above, there is the possibility 
that postsynaptic 5-HT 1A receptors located on interneurons or on serotonergic, 
dopaminergic, noradrenergic and cholinergic terminals may have a modulatory 
action on the output of these systems on cortical neurons [39, 41-44], facilitat¬ 
ing noradrenaline, dopamine [42] and possibly also ACh release [43, 44], In 
addition, an in vitro study in primary cultures of rat cortical neurons showed 
that 5-HT through 5-HT 1A receptors inhibits GABA release and has a dual 
modulation on glutamate release, mostly consisting in synaptic facilitation [83], 
ACh, noradrenaline, dopamine and glutamate are part of the neurotransmit- 
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ters involved in cortical arousal [73], Postsynaptic activation of 5-HT 1A recep¬ 
tors in the hypothalamus appears to modulate the release of orexin [84], a pep¬ 
tide regulating food intake and arousal [73]. 

It should be considered that systemic administration of 8-OH-DPAT in the 
dose range considered to elicit wakefulness (e.g., above 0.1 mg/kg) also pro¬ 
duces complex behavioral effects (e.g., increased motor activity, increased feed¬ 
ing, decreased anxiety, decreased body temperature) that may indirectly pro¬ 
mote arousal. This possibility is discussed below. 

Secondly, the decrease in SWS and REM sleep observed after systemic ad¬ 
ministration of 5-HT 1A agonists in the majority of studies (Tab. la) is likely due 
to postsynaptic 5-HT 1A receptors-mediated inhibition of neurons crucial for 
SWS and REM sleep generation. The neurons of the lateral-dorsal tegmentum 
(LDT) and ponto-peduncolo-tegmentum (PPT) collectively known as meso- 
pontine cholinergic REM-on neurons, are inhibited by perfusion or microin¬ 
jection of 5-HT 1A agonists [72, 85], Similarly, serotonin has an inhibitory role 
on the GABAergic neurons in the ventro-lateral preoptic area (VLPO) [86], 
an area crucial for SWS generation [87, 88], possibly with the contribution of 
5-HT 1A receptors. 

It may be expected that selective 5-HT 1A antagonists would produce an effect 
opposite to the agonists. However, it has been suggested that selective antago¬ 
nists for the 5-HT 1A receptors are silent, meaning that they block the effects of 
the agonists without showing any intrinsic activity [89-91], A reverse action 
may be expected after administration of the antagonist only when a receptor 
mediates a strong tonic response, since the receptor block will correspond to an 
interruption of the tonic inhibitory or excitatory effects. 

Very few studies have been carried out until now to assess the effect of 
5-HT 1A antagonists on sleep. The most selective 5-HT 1A antagonists used in 
sleep studies are p-MPPI and WAY 100635, which have been shown to be ac¬ 
tive at both pre- and postsynaptic 5-HT 1A receptor sites [89, 91-94] (Tab. lb). 
Only the studies using the most selective ligands are discussed here. 

Systemic administration of p-MPPI blocks 5-HT 1A autoreceptors and in¬ 
creases dorsal raphe unit activity during wakefulness (when serotonergic neu¬ 
rons show higher level of activity), whereas it has no effect during sleep (when 
serotonergic neurons show minimal activity) [92], Consequently, it may be 
expected that state is altered only when p-MPPI is perfused during wakeful¬ 
ness, possibly resulting in more serotonergic activity and arousal. Failure to 
acknowledge this effect may result in misinterpretation of the data. However, 
in our knowledge there are no studies that take such state-specific effect into 
account. 

P-MPPI antagonizes the effects of 8-OH-DPAT on sleep and behavior in 
rats [95], Sorensen and collaborators [96] also showed that after administration 
of p-MPPI alone (1, 5 or 10 mg/kg i.p. ) there was a dose-dependent suppres¬ 
sion of REM sleep. Waking was increased at the highest doses, whereas deep 
sleep was decreased only at the lowest dose. Similarly, Monti and colleague [72] 
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reported that WAY 100635 (0.46 and/or 0.92 pmol/kg, s.c.) increased waking 
and REM sleep latency and reduced REM sleep and the number of REM sleep 
periods in rats. On the other hand, Boutrel and collaborators [62] showed, in 
wild-type mice, that WAY 100635 (0.5 mg/kg, i.p.) increases REM sleep. An¬ 
other study using a 5-HT 1A receptor antagonist less selective than p-MPPI and 
WAY 100635, the NAN-190 (0.5 mg/kg i.p.) showed a decreased REM sleep 
and SWS [97] (Tab. lb). 

With one exception, these findings show that the 5-HT 1A antagonists tested 
affect state in a way similar to the agonists. The most consistent result is a de¬ 
crease of REM sleep. This may suggest that residual partial agonist properties 
may be present even in these selective compounds. In addition, as already con¬ 
sidered for the agonists, a flaw in these studies may have arisen by not taking 
into account the state during which perfusion of the antagonist was started. 
According to the study of Bjorvatn and collaborators [92] this may have con¬ 
siderably altered the outcome of the studies. Finally, it should also be taken 
into account that the dosage used may have played a role in determining the 
outcome of the experiment by producing a combination of pre- and postsyn- 
aptic block and making the results difficult to interpret. The specific efficacy of 
p-MPPI and WAY 100635 at pre- and postsynaptic 5-HT 1A receptors was not 
assessed in the experiments reported above. 


Table lb Effects of the systemic administration of 5-HT 1A antagonists. 


Authors 

Drug 

Dose 

Effect 

Neckelman 
et at. [97] 

NAN-190 

0.5 mg/kg i.p. in rats 

Decreased REM sleep and SWS 

Sorensen et 
al. [96] 

p-MPPI 

1, 5 and 10 mg/kg i.p. 

REM sleep was suppressed, deep SWS 
was decreased, W was increased 

Boutrel et 
al. [62] 

WAY100635 

0.5 mg/kg, i.p. in mice 

Increased REM sleep in wild-type mice 

Monti and 
Jantos [72] 

WAY 100635 

0.23, 0.46, 0.92 pmol/ 
kg, s.c. 

Reduced REM sleep and the number of 
REM periods, increased W and REM 
sleep latency 
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Effect of local administration of 5-HT 1A agonists and antagonists in DRN 
and projection areas involved with state modulation 

To act effectively on specific targets containing 5-HT 1A receptors it is desirable 
to perfuse or inject a drug directly into the DRN or into projection areas rich 
in 5-HT 1A receptors. A certain degree of diffusion has, however, to be taken 
into account especially in the case of microinjections when a high concentra¬ 
tion of a drug is introduced at once in a given brain region [98], A pioneering 
study showed that microinjection of 8-OH-DPAT (1-4 pg in 0.5 pi or reported 
in molarity 6-24 mM) in the DRN decreases wakefulness and increases SWS 
[58], A trend towards decrease in wakefulness was observed also by Portas 
and collaborators [30] during microdialysis perfusion of 10 pM 8-OH-DPAT 
in the DRN. Most studies showed that perfusion of 5-HT 1A agonists in the 
DRN {e.g., perfusion of 10 pM 8-OH-DPAT [30, 61]; microinjections of 50 ng 
8-OH-DPAT [99], microinjections of flesinoxan (25-50 ng) [99, 100]; microin¬ 
jections of flesinoxan (0.03, 0.06 and/or 0.12 nmol) [101]} significantly increase 
REM sleep compared to control condition. In contrast, one study reported a 
reduction of SWS and an increase of wakefulness after 8-OH-DPAT micro¬ 
dialysis perfusion in the DRN of cats (100-500 pM) [102] with no significant 
effect on REM sleep. However, at the highest concentration REM sleep oc¬ 
curred directly after waking, as in narcolepsy, suggesting that even in this study 
REM sleep is disinhibited by 8-OH-DPAT [102], The difference in the dosage 
required to elicit such effect remains controversial (Tab. 2a). It should also be 
considered that LDT and PPT may not be the only areas involved with REM 
sleep promotion [103], 

Overall these findings suggest that REM sleep is the state more directly af¬ 
fected by inhibition of DRN neurons activity (Tab. 2a). It was assumed that 
selective 5-HT 1A agonists, should primarily affect presynaptic 5-HT 1A DRN 
autoreceptors when injected locally. As a consequence 5-HT neuronal activity 
would be reduced [24-26], The degree of serotonergic inhibition would affect 
REM sleep by decreasing the tonic inhibition on mesopontine REM-on neu¬ 
rons [103], The inhibitory action of serotonin on brainstem REM-on cells is 
supported by in vitro and in vivo experiments. In vitro, 5-HT directly inhibits 
the LDT/PPT mesopontine cholinergic neurons [104, 105] largely accountable 
for REM sleep generation [103], Hence, a decreased serotonergic input to these 
neurons would likely result in increased REM sleep. This possibility is con¬ 
sistent with in vivo observations that local infusion of 8-OH-DPAT (0.01 pg) 
or 5-HT (100 nl of 1-1.5 mM solution) into mesopontine cholinergic neurons 
reduces REM sleep [85, 106], respectively. In line with these findings, microin¬ 
jection of the 5-HT 1A agonist flesinoxan (0.03, 0.06 and/or 0.12 nmol) into the 
LDT reduces REM sleep, the number of REM sleep periods, and augments 
REM sleep latency [72,101]. In addition, these data fit with neurophysiological 
reports showing that 5-HT raphe neurons are virtually silent during REM sleep 
[47-50], 
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The decrease in waking shown in some of the studies (Tab. 2a) may reflect 
another aspect of serotonin mediated state modulation. It was remarked above 
that a lower serotonergic activity is usually associated with sleep [47-50, 74], In 
line with this possibility, we have previously highlighted that widespread acti¬ 
vation of 5-HT 1A receptors (e.g., after systemic administration of high dosage 


Table 2a Effect of local administration of 5-HT 1A agonists in DRN and projection nuc¬ 
lei involved with state regulation. 


Author 

D "" ! 

Administration 

modality 

Dose 

Effect 

Monti and 
Jantos [58] 

8-OH-DPAT 

Microinjection 
in DRN 

1-4 gg 

Decreased W and increased 

SWS 

Portas 
et al. [30] 

8-OH-DPAT 

Perfusion in 

DRN 

10 pM 

Increased REM sleep, 
tendency to decreased W 

Bjorvatn 
et al. [61] 

8-OH-DPAT 

Perfusion in 

DRN 

10 pM 

Increased REM sleep 

Monti 
et al. [100] 

Flesinoxan 

Microinjection 
in DRN 

25.0, 50.0 ng 

Increased REM sleep dur¬ 
ing the second and third 

2 h period of recording 

Sakai and 

Crochet 

[102] 

8-OH-DPAT 

Perfusion in 

DRN 

5,10, 20, 50, 

100, 500 pM 

Increased W and decrease 
SWS at the higher two 
doses. At the highest 
concentration REM sleep 
occurred directly after W, 
as in narcolepsy 

Monti 
et al. [99] 

Flesinoxan 

8-OHDPAT 

Microinjection 
in DRN 

25.0-50.0 ng 

50.0 ng 

Increased REM sleep 

Monti and 
Jantos [101] 

Flesinoxan 

Flesinoxan 

Microinjection 
in DRN 
Microinjection 
in LDT 

0.03, 0.06, 

0.12 nmol 

0.03, 0.06, 

0.12 nmol 

Increased REM sleep 

Reduced REM sleep 

Monti and 
Jantos [72] 

Flesinoxan 

Microinjection 
in LDT 

(0.03, 0.06 and/ 
or 0.12 nmol) 

Reduced REM sleep and 
the number of REM peri¬ 
ods, and augmented REM 
sleep latency 
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5-HT 1A agonists) is consistently associated with increased wakefulness. Hence, 
a decreased serotonergic output is likely to hinder such effect. 

The picture becomes more complicated after administration of 5-HT IA an¬ 
tagonists in the DRN or projection nuclei involved in sleep modulation. So¬ 
renson and colleagues [107] showed that perfusion of 10 pM p-MPPI in the rat 
DRN induces a small reduction of REM sleep without affecting other states. 
However, Bjorkum and collaborators [32] found an increase in waking after 
perfusion of the same concentration of p-MPPI (10 pM) in the cat DRN. Per¬ 
fusion of another selective antagonist WAY 100635 (50 or 500 pM) in the cat 
DRN did not have any effect on sleep or waking [102], whereas, in rats, micro¬ 
injection of WAY 100635 (12.5, 25.0 and 50.0 ng or 0.06 and/or 0.12 nmol) into 
the DRN significantly decreased REM sleep [72, 99, 100], Finally, direct perfu¬ 
sion of the 5-HT 1A antagonist WAY 100635 (0.06 and/or 0.12 nmol) into the rat 
LDT increases REM sleep and the number of REM periods [72] (Tab. 2b). 

Once again, the most consistent result observed after DRN administration 
of the antagonist WAY 100635 was a decrease of REM sleep [99, 100, 107], 
This fits well with the general model of serotonergic modulation of REM sleep 
[103], and with the finding that the same antagonist has opposite effect on 


Table 2b Effect of local administration of 5-HT 1A antagonists in DRN and projection 
nuclei involved with state regulation. 


Author 

Drug 

Administration 

modality 

Dose 

Effect 

Sorensen 
et al. [107] 

p-MPPI 

Perfusion into 

DRN in rats 

10 pM 100 pM 

Decreased REM sleep in rats 

Bjorkum 
et al. [32] 

p-MPPI 

Perfusion) into 
DRN in cats 

10 pM 

Increased W 

Sakai and 

Crochet 

[102] 

WAY 

100635 

Perfusion into 

DRN in cats 

(50 or 500 pM) 

No effect on sleep or W 

Monti 
et al. [100] 

WAY 

100635 

Microinjection in 
DRN in rats 

(12.5,25.0 and 
50.0 ng) 

Decreased REM sleep during 
the first and/or second 2-h 
recording period 

Monti 
et al. [99] 

WAY 

100635 

Microinjection in 
DRN in rats 

(12.5, 25.0 and 
50.0 ng) 

Decreased REM sleep during 
the first and/or second 2-h 
recording period 

Monti and 
Jantos [72] 

WAY 

100635 

Microinjection in 
LDT in rats 

(0.03, 0.06, 0.12 

Increased REM sleep and 
the number of REM periods 
during the first and/or 
second 2 h of recording 
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REM sleep when injected in LDT and PPT, two of the main nuclei for REM 
sleep initiation known to be under 5-HT inhibitory control [85, 106], However, 
it is difficult to gain a clear understanding due to the contradictory findings 
in other studies (e.g. [102]). As considered above, an antagonist cannot be ex¬ 
pected to elicit a response opposite to the one observed after administration of 
an agonist. The effect of the antagonists may be limited at preventing recep¬ 
tor activation by the agonists [89-91], In addition, some antagonists may have 
residual agonist activity on the receptors [108] even if this has not been shown 
for ligands like p-MPPI and WAY 100635. Also, it should be kept in mind that 
5-HT 1A antagonists like p-MPPI and WAY 100635 show a state-dependent ef¬ 
fect when administered systemically since their effect on serotonergic firing is 
only evident during wakefulness [26, 61, 93], Hence, it is possible that the ef¬ 
fects of administration of such ligands in states other than wakefulness may 
become null since neuronal activity would remain unaltered. 


5-HT 1A agonists and circadian rhythm 

The role of serotonin in the regulation of the mammalian circadian clock 
should be taken into account in the present context. Serotonin appears to regu¬ 
late the response of the suprachiasmatic nucleus (SCN) circadian clock to light 
through multiple serotonergic receptors including the postsynaptic 5-HT 1A [109, 
110], A daily rhythm in the output of 5-HT in the SCN of rodents has been re¬ 
ported [111] with peak levels reached at the transition between the light and the 
dark period. In addition 5-HT 1A agonists produce a dose-dependent increase 
in nocturnal melatonin [112], The relevance of these findings are extensively 
discussed in the chapters by Semba and Pandi-Perumal/Cardinali. 


Action of 5-HT 1A agonists may also affect state 
by affecting complex behaviors 

5-HT 1A agonists that inhibit DRN 5-HT activity are also able to annul anxi¬ 
ety and fear, increase motility, and increase feeding behavior, and low doses of 
5-HT 1A agonists also decrease body temperature (this is a postsynaptic effect). 
These actions can have direct consequences on state modulation and are there¬ 
fore discussed in details in the next four paragraphs. 


5-HT 1A receptors and anxiety 

Some of the effects shown by 5-HT 1A agonists on state modulation may 
be mediated by their anxiolytic action. It has been shown that injection of 
8-OH-DPAT into the DRN (0.02-1 pg or translated in molarity 1.12-56 mM) 
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produces anxiolytic effects in multiple models of anxiety including the social 
interaction paradigm and the water-lick conflict test [113, 114], This effect is 
mainly understood as a consequence of stimulation of presynaptic 5-HT 1A au¬ 
toreceptors consistent with the hypothesis that decreased serotonergic activity 
in forebrain projection areas diminishes anxiety [115, 116], Some studies show 
that 5-HT 1A agonists injected systemically produce biphasic effects according 
with the occurrence of mixed pre- and postsynaptic effects; however, their anx¬ 
iolytic effect is consistent in a variety of stress models [13]. It is plausible that 
postsynaptic receptors in selected brain regions also play a role in the anxio¬ 
lytic response. For example, 5-HT 1A receptors mediate the inhibition on limbic 
(e.g., amygdala) and cortical release of glutamate supposed to have anxiogenic 
effects [117, 118]. Also, it has been shown that the 5-HT 1A agonist flesinoxan 
exerts its anxiolytic action in the fear conditioning paradigm through stimula¬ 
tion of postsynaptic 5-HT 1A receptors in the hippocampus and amygdala [119]. 
Similarly, 8-OH-DPAT injected in the hippocampus produces anxiolytic effects 
in a passive avoidance task [120], In contrast to these findings, it has been re¬ 
ported that 5-HT 1A agonists administered in the septum [121], amygdala [122, 
123] and hippocampus [124, 125] may have anxiogenic effects. Hence, it is still 
unclear if and at what level postsynaptic receptors are involved in the anxiolytic 
effects of 5-HT 1A agonists. Some discrepancies may arise from the type of test 
utilized to assess anxiety [13,125], 

Overall, the majority of studies support the fact that activation of 5-HT 1A 
receptors inhibits anxiety [13] especially via a presynaptic mechanism. In this 
view it seems plausible that a decreased level of anxiety would facilitate, in the 
short term, the establishment of sleep at the expenses of wakefulness. This pos¬ 
sibility should be considered when interpreting the effect of DRN administra¬ 
tion of 5-HT 1A agonists on state modulation. 


5-HT 1A receptors and motor activity 

Systemic administration of 5-HT 1A agonists with high intrinsic efficacy like 
8-OH-DPAT in the dose range considered to elicit wakefulness (e.g., above 
0.1 mg/kg for 8-OH-DPAT) also produces as a consequence of postsynap¬ 
tic 5-HT 1A receptors stimulation [126], a motor syndrome, the so-called 
5-HT syndrome. This is well evident at doses around 0.3 mg/kg s.c. of 
8-OH-DPAT and is characterized by flat body posture, tail flicks, abducted 
hind- and forelegs, reciprocal forepaw treading, head weaving and tremor [9, 
54, 127, 128], Flat body posture and forepaw treading appear within 3 min 
after systemic administration and reach the maximal effect after 30 min 
[128], Since, the motor effects occur very early after administration of the 
drugs and are short lasting [128], it is likely that the two mechanisms are un¬ 
related. However, it cannot be excluded that the increased wakefulness com¬ 
monly reported after systemic administration of 5-HT 1A agonists (especially 
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8-OH-DPAT) [55-61] is the result of concomitant behavioral and motor 
activation. 


5-HT lx receptors and feeding behavior 

Low doses of 5-HT 1A agonists (e.g., 8-OH-DPAT, ipsapirone) stimulate intake 
in freely feeding rats, probably by activating autoreceptors on the soma of 
5-HT neurons so that 5-HT release is decreased at the projection sites [17, 34, 
129, 130], including various medial hypothalamic nuclei important for feeding 
[131]. The hyperphagia cannot be accounted for by a simple increase of motor 
activity and is selective for carbohydrate in carbohydrate versus protein choice 
experiments [132], Another mechanism by which low-dose of 5-HT 1A agonists 
(e.g., 0-300 pg/kg of 8-OH-DPAT) may increase feeding is disinhibition of 
dopaminergic transmission occurring as a consequence of 5HT 1A autoreceptor 
stimulation and inhibition of 5-HT release [133], Vice versa, depression of self 
stimulation observed at higher doses of 8-OH-DPAT may reflect postsynaptic 
5-HT 1A receptors activation with consequent inhibition of dopaminergic 
transmission [133], In addition, 5HT 1A autoreceptor-mediated inhibition of 
5-HT release may also increase appetite by lack of activation of postsynaptic 
5-HT 1B and 5-HT 2C receptors subtypes that have recently been identified as 
modulators of serotonin-induced satiety [134], Finally, postsynaptic activa¬ 
tion of 5-HT 1A receptors in the hypothalamus appears to modulate the release 
of orexin [84], a peptide regulating food intake and arousal [73], The precise 
interaction between the serotonergic and the orexinergic system at this level 
remains unclear. 

Even though the dosage of 5-HT 1A agonists required to increase appetite is 
lower to the one known to increase wakefulness, feeding should be considered 
as a possible confound in 5-HT 1A -mediated state modulation. 


5-HT lx receptors and body temperature 

Low to moderate doses of 8-OH-DPAT (0.1-0.5 mg/kg s.c.) have been shown 
to consistently decrease body temperature in rodents up to 3°C [135], A quick 
decrease in body temperature has been suggested to promote arousal [136], 
Hence, it should be considered that any significant effect on body temperature 
mediated by 5-HT 1A receptors may potentially affect waking as well. 

Many other central actions are mediated by pre- or post-5-HT 1A receptors 
like aggressive behavior [11], alcohol dependence [18], hormone secretion [137, 
138], micturition [22], sexual behavior [23], etc.; however, these effects have no 
direct relation with state modulation. This makes their discussion beyond the 
reach of this chapter. 
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Effect of chronic alterations of 5-HT 1A receptors function on sleep 
and waking 

A chronic alteration of serotonergic function has been suggested to play a ma¬ 
jor role in the pathogenesis of depression [139], and possibly in some sleep al¬ 
terations commonly observed in depression [140], The large use of serotonin 
reuptake inhibitors (SSRIs) in depression has been linked to their properties 
to increase serotonin in the synapses [141], The desensitization of 5-HT 1A auto¬ 
receptors, e.g., produced by long-term administration of SSRIs or 5-HT 1A ago¬ 
nists is particularly relevant to the antidepressant response in humans because 
it allows restoring 5-HT release [142], The antidepressant response also includes 
reversal of some sleep alterations associated with depression [143], The effects 
of antidepressant drugs and 5-HT! agonists on human sleep are extensively 
explored in the chapter by Argyropoulos. 


Characteristics of the 5-HT 1B 

It appears that there is a species-specific nature, distribution and function of 
5-HT 1B receptors. The 5-HT 1B receptor was at first claimed to exist only in ro¬ 
dents (rat, mouse and hamster) [144], but later studies demonstrated that it is, 
in fact, the homologous species of the human 5-HT 1Dp receptor [145], Both are 
G protein-coupled receptors and their activation induces a decrease in adenylyl 
cyclase activity [146], Transduction of the receptor signal can also be mediated 
through the activation of mitogen-activated protein kinase (MAP kinase) sig¬ 
naling system [147], The difference between the human and rodent receptor is 
modest; still it can cause large pharmacological variation [148], For example, 
some (3-adrenergic antagonists, such as (-)propranolol, bind to 5-HT 1B recep¬ 
tors in rodents with a much higher affinity than to 5-HT 1Dp receptors. The main 
difference between the pharmacological profiles of 5-HT 1B and 5-HT 1Dp recep¬ 
tors is a result of a single amino acid exchange (replacement of threonine 355 
by asparagine, [148, 149]). Hence, the species-specific nature of 5-HT 1B recep¬ 
tors underscores the need to examine the functional aspects of the receptor in 
more than one animal species. This is particularly relevant for extrapolation of 
data to humans. The same receptor nomenclature is now applied to all mam¬ 
malians species [150], In this chapter 5-HT 1B and 5-HT 1Dp are referred to as 
5-HT 1B for simplification. 


Localization 

The 5-HT 1B receptors are, like the 5-HT 1A receptors, widely distributed in the 
CNS. They are predominantly localized at the presynaptic level [151-153], The 
distribution of 5-HT 1B receptor binding sites found in rat brain is comparable 
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to 5-HT 1B receptor binding sites observed in guinea pig and human, with a high 
density in the basal ganglia, particularly in the globus pallidus and in the sub¬ 
stantia nigra, as well as in the dorsal subiculum. Also, 5-HT 1B receptors are 
moderately expressed in the entopeduncular nuclei, superficial gray layer of the 
superior colliculus and periaqueductal gray, caudate, putamen, molecular layer 
of hippocampus, superior colliculus and the deep nuclei of cerebellum, and 
at a lesser degree localized in cerebral cortex, amygdala, hypothalamus, thala¬ 
mus and the superior layer of dorsal horn of the spinal cord (e.g., [152, 154]). 
Such multiplicity of localization cause important functional differences, as dis¬ 
cussed later. 

The distribution of the 5-HT 1B binding sites is different from the 5-HT 1B re¬ 
ceptor mRNA (e.g., [153, 155]). The 5-HT 1B receptor mRNA has been identi¬ 
fied in the raphe nuclei, SCN, cerebellum (Purkinje cell layer), striatum, hippo¬ 
campus (pyramidal cell layer of CA1), subthalamic nucleus, entorhinal and 
cingulated cortex (layer IV), retinal ganglion, olfactory tubercle and nucleus ac- 
cumbens, but not in the globus pallidus or the substantia nigra (e.g., [156, 157]). 
The mismatch between the distribution of the 5-HT 1B receptor protein and its 
encoding mRNA suggests that the 5-HT,„ receptors are mainly located at the 
nerve terminals, whereas their expression is low or absent at the somatodendritic 
level [157], However, a recent study showed 5-HT 1B immunoreactivity both in 
the cell body and the nerve fibers of cells localized in the hypothalamus [158], 


The function of 5-HT 1B receptors 

The presynaptic function of 5-HT 1B receptors is difficult to study due to the 
widespread localization in the CNS and the absence of highly selective agonists 
and antagonists. Higher density of 5-HT 1B receptors is found at the nerve ter¬ 
minals of different pathways: raphe nuclei and their projections [153,155,159], 
striato-nigral pathway [160, 161], and the retino-collicular pathway [162, 163], 

5-HT 1B receptors are present on the serotonergic axon terminals in nearly all 
parts of the CNS (e.g., [164]), where they act as autoreceptors [165], Their ac¬ 
tivation produces an inhibition of 5-HT release [166], 5-HT 1B receptors found 
on terminals of non-serotonergic neurons act as presynaptic heteroreceptors 
[151-153, 167], Their activation produces inhibition of release of different neu¬ 
rotransmitters (e.g. [167-170]). 

Consequently, the multiplicity of effects due to activation of 5-HT 1B recep¬ 
tors is mainly dependent on their localization. The complex modulatory func¬ 
tion operated by 5-HT 1B receptors also explains their contribution in the organi¬ 
zation of: feeding, locomotor activity, anxiety, depression, obsessive compulsive 
disorder, aggression, migraine, thermoregulation, hormone secretion, learning 
and state modulation [171]. It is likely that the effect of the 5-HT 1B receptors 
on state modulation is exerted not only through feedback control on serotonin 
output [166, 172], but also through the action of other neurotransmitters [167, 
173-175], This possibility is further discussed below. 
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Role of 5-HT 1B receptors on serotonergic neurons firing and 5-HT release 

5-HT 1B autoreceptors are involved in the control of extracellular 5-HT levels 
from the terminals and possibly cell body regions of serotonergic neurons 
[176], Yet, the role of 5-HT 1B receptors on serotonergic activity is controversial. 
Local activation of autoreceptors with 5-HT 1B agonists should reduce seroto¬ 
nergic activity [166, 172], In line with this hypothesis, a decrease of DRN ex¬ 
tracellular 5-HT was obtained after direct perfusion of the agonist CP 135,807 
in DRN (0.2 pM) [177], In another study, perfusion of the 5-HT 1B receptor 
agonist CP 93,129 in DRN, median raphe nucleus (MRN) and in several pro¬ 
jection areas like substantia nigra, ventral pallidum, lateral habenula and the 
SCN (30-300 pM) [166] and in the frontal cortex (0.030-3 pM) [178] also de¬ 
creased 5-HT release in each of these areas. Application of the same agonist, 
CP 93,129 (0.01-10 pM), in DRN slices produced a decrease in evoked 5-HT 
release [176, 179], Similarly, perfusion of the 5-HT 1B receptor agonist CGS 
12066A (0.01-1 pM) in DRN slices inhibited the electrically stimulated release 
of [ 3 H]serotonin [180], MRN perfusion of the agonist CP 94,253 decreases 
5-HT in dorsal hippocampus at low doses (0.3 and 3 pM) [166], Perfusion of 
the agonists RU 24969 (0.1 pM) in the dorsal hippocampus decreased the local 
release of 5-HT [181], Using the less selective 5-HT 1B agonist naratriptan, an 
earlier in vitro study reported a decreased 5-HT output in raphe (10 pM) and in 
hypothalamus slices (0.1 pM) [182], The possibility that the observed 5-HT de¬ 
crease is mediated by 5-HT 1B receptors is supported by the evidence that such 
response was unaffected by the selective 5-HT 1A antagonist WAY 100635 
(1 mM) and the selective 5-HT 1D antagonist ketanserin (1 mM) [182], 

Systemic administration of the agonist CP 93,129 (0.5-2 mg/kg i.v.) de¬ 
creased 5-HT output in dorsal hippocampus and globus pallidus [166], The 
agonist RU 24969 decreased 5-HT in the diencephalon [183] and in frontal cor¬ 
tex [184] after administration of 2.5 and 10 mg/kg i.p, respectively. 

All the studies mentioned above are consistent with the hypothesis that ac¬ 
tivation of 5-HT 1B autoreceptors should reduce serotonergic activity. However, 
other findings do not support this possibility. Early observations in vitro showed 
that 5-HT 1B receptor agonists failed to alter spontaneous 5-HT cell firing in 
rats DRN m-chlorophenyl piperazine (mCPP) and l-(3-trifLuoromethylphen- 
yl (piperazine (TFMPP) [24]; sumatriptan [185]). Further work in vivo showed 
that DRN perfusion of the non-selective 5-HT 1B agonists sumatriptan and the 
antagonist GR 127,935 (0.01-10 pM) did not change the DRN 5-HT output 

[186] , Moreover, release of 5-HT from hippocampal slices was enhanced by 
RU 24969 and TFMPP at concentrations from 1 to lOpmol [183], Systemic 
administration of 5-HT 1B receptor agonists has been shown to increase 5-HT 
cell firing in the DRN (CP 94,253, 3 mg/kg i.v. and RU 24969, 0.6 mg/kg i.v. 

[187] ; CP 135,807, 2.5-20 pg/kg i.v. [177]). Increase of serotonergic cell firing 
in DRN was not observed with the agonist CP 93,129 (0.05-1.6 mg/kg i.v.); 
however, this agonist increased the firing of MRN [166, 188], Similarly, the 
agonist CP 94,253 (0.5-2.0 mg/kg i.v.) in anesthetized rats, increased 5-HT in 
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MRN without affecting DRN 5-HT [166], There are several studies indicating 
that 5-HT 1B agonists are more effective in MRN compared to DRN [166, 188, 
189], Adell and collaborators [166] showed that, after administration of the ag¬ 
onist CP 93,129 (0.5-2 mg/kg i.v.), 5-HT output increased in the MRN despite 
a decrease was observed in the other areas. In line with this, acute treatment 
with the agonist CP 93,129 (7 mg/kg i.p.) increases 5-HT synthesis (measured 
by autoradiography) in the MRN, and in almost all of the projection areas, 
without significantly affecting the DRN [189], Most likely, 5-HT 1B receptors 
have differential roles in the DRN and MRN, which might be due to different 
efficacy or density of 5-HT 1B receptors in these nuclei. Another explanation 
for the differences present between studies has been provided by Adell and col¬ 
laborators [166], They reported a biphasic effect in cell firing and 5-HT release 
after perfusion of the 5-HT 1B agonist CP 94,253 in the MRN. 5-HT firing was 
reduced at 0.3-3 pM and increased at 300 pM [166] and 5-HT output in dor¬ 
sal hippocampus decreased at low doses (0.3 and 3 pM) but increased with a 
higher dose (300 pM). The use of anesthetized animals in some studies may 
also contribute to the confusion since the degree of tonic serotonergic activity 
appears to change according to the behavioral state of the animal [53], 

Chronic treatment with the 5-HT 1B agonist CP 93,129 (7 mg/kg/day s.c. for 
14 days), did not produce changes in 5-HT synthesis in the raphe nuclei or in 
the nerve terminal structures, except for the medial frontal bundle and the vi¬ 
sual and sensory-motor cortices [189], This suggests that chronic treatment of 
5-HT 1B agonists may result in a normalization of the 5-HT synthesis likely as 
a consequence of desensitization of 5-HT 1B autoreceptors and/or heterorecep¬ 
tors. 

The 5-HT 1B antagonists are quite effective in preventing the 5-HT 1B ago¬ 
nist effect on 5-HT firing and release in both the DRN (e.g., CP 94,253 and 
RU 24969 antagonized by GR 127,935 [187]; CP 135,807 antagonized by GR 
127,935 or risperidone [177]) and the MRN (CP 93,129 antagonized by SB 
224289 [166, 188]). In line with the autoinhibitory action of 5-HT 1B receptors 
on serotonergic function, perfusion of methiothepin (10-100 pM), a non-se- 
lective 5-HT, antagonist, increases DRN 5-HT release [186], A new 5-HT 1B 
selective antagonist AR-A000002 (0.9-18 mg/kg s.c.) increases 5-HT metabo¬ 
lism, 5-HT synthesis and release in guinea pig frontal cortex [190], whereas 
the 5-HT 1B receptor antagonist SB 224289 does not affect 5-HT level in the 
frontal cortex of either guinea pigs or rats (4 mg/kg i.p.) [191], but produces 
an increase in 5-HT in the dorsal hippocampus of guinea pigs only. The latter 
findings suggest that differences between ligands and between animal species 
may play a confounding role. 

Overall these findings show that 5-HT 1B receptors are directly involved in the 
modulation of serotonergic neurons firing and serotonin release. Most of the 
putative agonists show an inhibitory effect on serotonergic activity, whereas the 
antagonists appear to reverse the agonists’ effects. However, conflicting find¬ 
ings are also present. The unavailability of selective agonist and antagonists 
may contribute to the discrepancy between studies. There is a strong similarity 
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between 5-HT 1B and 5-HT 1D receptors, which has made their pharmacological 
differentiation difficult. Some of the agonists and antagonists thought to be 
5-HT 1B selective are found to be equally potent at 5-HT 1D receptors (Fig. 1). 
Although electrophysiological findings show that 5-HT output in the dorsal 
raphe is more dependent on activation of 5-HT 1A and 5-HT 1B receptors than 
on the 5-HT 1D receptor [192], some in vitro and in vivo studies suggest that the 
latter may also play a role [177, 179, 185, 193], Hence, the development and 
availability of highly selective ligands is crucial for future research on 5-HT 1B 
receptors. 


Implication of 5-HT 1B receptors in control of synaptic neurotransmission 

5-HT 1B receptors are traditionally associated with serotonin autoreceptor 
function; however, most of the 5-HT 1B receptors in the brain are expressed 
in non-serotonergic neurons acting as inhibitory heteroreceptors and thereby 
controlling the release of a variety of different neurotransmitters in different 
neurons. 5-HT 1B receptors are located presynaptically on cholinergic as well as 
glutamatergic, GABAergic and dopaminergic terminals [167, 168, 170] directly 
modulating the release of ACh [173], glutamate [174], GABA [175] and dopa¬ 
mine [167], respectively. By modulating the activity of these neurotransmitters, 
5-HT 1B heteroreceptors also exert an indirect control on other neural systems. 

In vitro data suggest that activation of 5-HT 1B receptors by the agonist CP 
93,129 have an inhibitory effect on acetylcholine release from synaptosomes 
of rat hippocampus [167], Systemic administration of the newer 5-HT 1B recep¬ 
tors antagonist NAS-181 (1-10 mg/kg s.c.) causes a dose-dependent increase in 
ACh levels in the ventral hippocampus and frontal cortex [194], Taken together 
these data suggest that ACh neurotransmission in the frontal cortex and ven¬ 
tral hippocampus, brain structures strongly implicated in cognitive function, is 
under tonic inhibitory control of 5-HT 1B heteroreceptors localized at the cho¬ 
linergic terminals in these areas. This may also have important consequences in 
state modulation as discussed later. 

Also, hippocampal glutamate output to the subiculum, local CA1 feedback 
inhibition and local CA1 excitatory transmission are reduced after activation 
of 5-HT 1B receptors on CA1 pyramidal cell axons [195], Local perfusion of the 
5-HT 1B receptor agonist CP 93,129 (50-500 pM) in prefrontal cortex inhibits 
glutamate and aspartate release in this region during veratridine-evoked depo¬ 
larization of cortical neurons [169], However, the antagonist NAS-181 (10 or 
20 mg/kg s.c.) shows no effect on basal extracellular levels of glutamate in the 
ventral hippocampus or frontal cortex [194], 5-HT 1B activation by perfusion of 
the agonist TFMPP in SCN reduces local glutamate output [196], This indi¬ 
cates a role for 5-HT 1B receptors in glutamate mediated relay of photic infor¬ 
mation to the SCN. Moreover, presynaptic localization of 5-HT 1B receptors in 
the superficial gray layer of the superior colliculus suggests that these receptors 
may control the release of /V-acetyl-aspartyl-glutamate (NAAG), which prob- 
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ably serves as a neurotransmitter in the optic tract [197], In our knowledge no 
study at the present time has addressed the effect of 5-HT 1B agonists on the 
release of NAAG. The modulatory function of 5-HT 1B receptors on glutamate 
and NAAG may affect sensitivity to light and thereby the circadian rhythm. 
This possibility is discussed below. 

The interaction between the GABAergic and serotonergic function has been 
extensively explored in the DRN [198], In the raphe nuclei there is a reciprocal 
influence between serotonergic projection neurons and the GABAergic inter¬ 
neurons or afferents. These interactions appear to be mediated by presynaptic 
5-HT 1B , 5 -HT 1a and postsynaptic GABA (A/B) receptors [180], Activation of the 
5-HT 1B receptors in slices from the DRN and MRN by the agonist CGS 12066A 
(0.01-1 pM) inhibits electrically stimulated [ 3 H]serotonin and [ 3 H]GABA re¬ 
lease; inhibition of [ 3 H]GABA release is still present after depletion of raphe 
serotonin neurons [180], The inhibition of 5-HT and GABA in the DRN by 
presynaptic 5-HT 1B receptors may have consequences for state control, as con¬ 
sidered below. Modulation of GABA release via 5-HT 1B receptors has also been 
found in axonal projections of Purkinje cells of the cerebellum [199], in the 
SCN [200], globus pallidus [175], substantia nigra [201] and ventral tegmental 
area [202], Systemic administration of the antagonist NAS-181 (10 or 20 mg/kg 
s.c.) shows no effect on GABA extracellular levels in ventral hippocampus and 
frontal cortex [194], 

The 5-HT 1B receptors found in the retino-tectal pathway [162, 163] and on 
GABAergic terminals of the SCN [200] may modulate the sensitivity to light 
and the circadian rhythm. Application of the 5-HT 1B agonist CP 93,129 (1 pM) 
to SCN neurons in hypothalamic slices decreases GABA release [200], This 
modulation carries important implications for circadian rhythm modulation 
(see below). 

Inhibition of GABA release in central motor control nuclei like the substan¬ 
tia nigra [201] and the globus pallidus [175] may in part be responsible of the 
changes in motor activity observed as a result of 5-HT 1B receptor activation 
[203, 204], This may also affect indirectly the level of arousal (see below). 

GABAergic terminals arising from the striatum constitute a major part of 
afferents contacting dendrites of dopaminergic neurons (e.g. [205]). It has been 
proposed that 5-HT 1B receptors modulate the activity of mesoaccumbens do¬ 
pamine via inhibition of GABA release from GABAergic projections in the nu¬ 
cleus accumbens [202, 206, 207], A similar mechanism has been suggested for 
5-HT 1B receptor regulation of both the GABAergic projections to the ventral 
tegmental area and the substantia nigra [206, 208-210] and the hippocampo- 
accumbens glutamate projection [163], Local perfusion of the 5-HT 1B agonist 
CP 93,129 (80 pM) decreases GABA and increases dopamine in the ventral 
tegmental area, these effects are antagonized by the 5-HT 1B receptor antagonist 
SB 216641 (10 pM) [202], 

Also, there is evidence that 5-HT 1B activation acts directly on dopaminergic 
neurons. In vitro data showed that the agonist CP 93,129 inhibits is the K + - 
evoked overflow of [ 3 H]dopamine from synaptosomes of rat striatum [211], an 
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effect antagonized by a 5-HT 1B antagonist (SB 224289). The firing rate of dopa¬ 
minergic neurons in the ventral tegmental area is reduced after systemic admin¬ 
istration of the agonists TFMPP (1.25-160 pg/kg i.v.) and mCPP (1.25-320 pg/ 
kg i.v.) [212], However, perfusion of the 5-HT 1B receptors agonist CP 93,129 
(50 pM) in the striatum locally produces a fivefold increases of dopamine in 
mice [213], An increased activity of neurons located in nucleus accumbens and 
ventral tegmental area may have an arousing effect due to activation of brain 
motivation/reward circuitry (e.g., food seeking) as discussed ahead. It appears 
that 5-HT 1B heteroreceptors located on dopaminergic and cholinergic terminals 
in the striatum are less sensitive than the 5-HT 1B autoreceptors [167], 

Hence, modulation of the 5-HT 1B receptors has important consequences in 
the physiological control of the release of serotonin and of other neurotrans¬ 
mitters. 


Role of 5-HT 1B receptors and the modulation of state and circadian rhythm 

The controversial role of 5-HT 1B receptors in the control of serotonergic, and 
non-serotonergic, cell firing is also evident in these receptors’ role in state modu¬ 
lation. Systemic administration of different 5-HT 1B agonists (e.g., RU 24969, 
CGS 12066B, CP 94,253, TFMPP) shows a fairly consistent dose-dependent 
increase in waking and reduction of REM sleep in rats (RU 24969, 0.63 mg/ 
kg i.p. [214]; RU 24969, 0.5-2.0 mg/kg s.c. [57]; CGS 12066B, 3-14 mg/kg i.p. 
[215]; CP 94,253, 5.0-10.0 mg/kg s.c. [216]; CP 94,253, 1-10 mg/kg i.p. and RU 
24969, 0.25-2.0 mg/kg i.p. [217]; TFMPP, 0.10-1.25 mg/kg s.c. [218]) and REM 
sleep latency is correspondingly increased [57, 215], 

The effect of 5-HT 1B agonists on SWS is more ambiguous. A decrease (RU 
24969 [57, 214]; CP 94,253 [216]), an increase (TFMPP [218]) and only minor 
effects on SWS (CGS 12066B [215]) have been described. EEG power spec¬ 
trum analysis after systemic administration of the agonist CGS 12066B shows 
a dose-dependent reduction of power densities in waking and SWS, suggesting 
a tendency towards a general deactivation [215], Similarly, the agonist TFMPP 
produces delta waves 2h after administration [218], Since all data provided 
above were obtained after systemic administration of 5-HT 1B agonists, it should 
be considered that systemic administration may elicit nonspecific responses due 
to mixed hetero- and autoreceptors activation making the outcome difficult to 
interpret. 

As discussed above, the 5-HT 1B antagonists are quite effective in preventing 
the 5-HT 1B agonist effect on 5-HT firing and release [166, 177, 187, 188]; how¬ 
ever, their effects on state modulation are less consistent. The literature on sys¬ 
temic administration of 5-HT 1B antagonists is sparse. Systemic administration 
of the 5-HT 1B antagonist GR 127935 induced a dose-dependent enhancement 
of REM sleep 2 h after the administration [217], The antagonist GR 12793 
largely prevented 5-HT 1B agonist-mediated (RU 24969 and CP 94,253) decrease 
in SWS [217], Moreover, pretreatment with the non-selective 5-HT 1B antagonist 
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pindolol reversed the effect of CP 94,253 on waking and SWS, while REM 
sleep remained suppressed [216], In another study, the increase in waking af¬ 
ter the agonist RU 24969 was not reduced by drugs with 5-HT 1B antagonistic 
properties (methiothepin, cyanopindolol or propranolol [57]), but its arousing 
effect was actually potentiated by methiothepin and propranolol [57], Adminis¬ 
tration of newer and more selective 5-HT 1B receptors antagonists like NAS-181 
and AR-A000002 has been shown to increase 5-HT metabolism and synthesis 
[190, 219], According to the influence that increased serotonergic activity has 
on state [49, 53], this might be associated with more wakefulness. Up to now 
there are no reports on state modulation produced by this drug. 

An involvement of 5-HT 1B receptors in the modulation of REM sleep is evi¬ 
dent in 5-HT 1B knockout mice. Boutrel and collaborators [217] observed that 
these mice display higher amounts of REM sleep and they lack REM sleep re¬ 
bound after sleep deprivation. In addition, knockout mice show lower amounts 
of SWS. It is, however, necessary to have in mind that regional plasticity devel¬ 
ops between somatodendritic and terminal autoreceptors after the genetic dele¬ 
tion of 5-HT 1B (as well as for 5-HT IA ) receptors [220], As a consequence, some 
complementary adaptive changes may take place during CNS development. For 
instance, thermoregulation, a process involving the functional activity of both 
somatodendritic 5-HT 1A and 5-HT 1B receptors (e.g., [221]), is altered (hypother¬ 
mia) in mutant mice lacking 5-HT 1B receptors [222], Hypothermia is induced 
by 5-HT 1B agonists in rats (CGS 12066B [223]) and guinea pigs (SKF 99101H 
[224]). Hence, the possibility that 5-HT 1B ligands may affect the vigilance state 
by altering thermoregulation should be considered. It has earlier been empha¬ 
sized that acute decrease of body temperature promotes arousal [136], 

The 5-HT receptor has received substantial attention with respect to its role 
in the circadian rhythm regulation. Systemic administration of 5-HT 1B agonists 
prior to light stimulation inhibits the phase advancing effect of light and the 
Fos expression in the SCN (TFMPP in mouse [225]; TFMPP and CGS 12066A 
in hamster [226]; CGS12066B in inbred rats with a decreased light sensitivity 
[227]). Systemic administration of the agonist TFMPP also attenuates the ef¬ 
fect of light on pineal melatonin production in a dose-related manner [228], 
Local activation of presynaptic 5-HT 1B receptors on retinal terminals in the 
SCN produces a complete inhibition of light-induced phase advance (TFMPP, 
1 mM [226]). The decreased sensitivity to light may depend on 5-HT 1B -medi- 
ated inhibition of GABA release. In line with this possibility, 5-HT 1B recep¬ 
tors are found on GABAergic terminals of the SCN [200] and application of 
the 5-HT 1B agonist CP 93,129 (1 pM) to SCN neurons in hypothalamic slices 
decreases GABA release [200], In addition, it has been proposed that the de¬ 
creased sensitivity to light may result from 5-HT 1B -mediated inhibition of glu¬ 
tamate dependent flow of photic information to the SCN. A 5-HT 1B receptor 
agonist reduces glutamatergic excitatory postsynaptic currents in SCN slices of 
the wild-type mouse [226, 229], while in vivo perfusion of the agonist TMFPP 
in SCN reduces local glutamate output [196], 5-HT 1B receptors may also con¬ 
trol the release of NAAG, which has been suggested to be a transmitter candi- 
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date in the optic tract [197], The modulation of NAAG may contribute to the 
5-HT 1B -mediated sensitivity to light and thereby influence circadian rhythm. 
The activity of 5-HT 1B receptors in the region of the SCN shows circadian fluc¬ 
tuation [230], Hence, it is important to take this into account when administrat¬ 
ing 5-HT 1B ligands since their effect may change depending on the circadian 
phase. 

Overall, the 5-HT 1B receptors effect on circadian rhythmicity may delay sleep 
onset and therefore affect state modulation. Studies in the 5-HT 1B mutant type 
of Drosophila support the possibility that that the role of the 5-HT 1B receptor 
may be more related to circadian rhythm than to the regulation of baseline 
sleep. Flies expressing high levels of the 5-HT 1B receptor have reduced circadian 
light responses [231], whereas flies with reduced levels of 5-HT 1B display en¬ 
hanced light-induced phase shifts [232], No effect on sleep, either expressed as 
total amount or average length of sleep bouts, was observed in 5-HT 1B mutant 
flies [231], 

In 5-HT 1B knockout mice, the phase shifts induced by light are not modi¬ 
fied by 5-HT 1B receptor agonists. In vitro, the 5-HT 1B receptor agonist TFMPP 
has no effect on the glutamatergic excitatory postsynaptic currents to SCN 
in hypothalamic slices of 5-HT 1B knockout mice [229, 233], Similarly, the 5- 
HT ib receptor agonist CP 93,129 has no effect on the postsynaptic currents in 
SCN neurons of knockout mice [200], Although the circadian period of 5HT 1B 
knockout mice does not differ from that of the wild-type mice in normal light 
conditions, the period becomes longer under constant light [234], This effect is 
accompanied by a reduced light-induced Fos expression [235], consistent with 
the view that this strain lacks inhibitory control of retinal input to the circadian 
system. The role of knockout mice in the understanding of 5-HT 1B receptors 
function is very promising. An extensive discussion of knockout studies can be 
found in the chapter by Adrian. 

As shown for the circadian rhythm modulation, 5-HT 1B agonist and antag¬ 
onists may affect sleep and waking by acting also on non-serotonergic path¬ 
ways. For example 5-HT 1B receptors may modulate state by affecting the corti¬ 
cal release of monoamines and other neurotransmitters crucial in maintaining 
arousal [73], Preliminary data suggest that 5-HT 1B activation may inhibit corti¬ 
cal ACh [167], whereas 5-HT 1B receptors block may enhance the level of cortical 
ACh [194], Moreover, 5-HT 1B agonists appear to decrease glutamate and aspar¬ 
tate release in prefrontal cortex [169], In this respect the activation of 5-HT 1B 
receptors produce opposite effects on the release of cortical neurotransmitters 
important for arousal (e.g., ACh and glutamate) compared to the activation of 
5-HT 1A receptors [43, 44, 83], These findings are hardly reconcilable with the 
general arousing effect shown by 5-HT 1B agonists [57,214-217], However, it has 
been shown that systemic administration of 5-HT 1B agonists also stimulates the 
noradrenergic neurons in the locus coeruleus (CGS 12066B [236]) consistent 
with the promotion of arousal. 

In addition, 5-HT 1B receptors may modulate state via a complex interaction 
with the GABAergic input to DRN [180], GABAergic terminals have been 
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identified on rat DRN serotonergic neurons [237], Perfusion of the 5-HT 1B re¬ 
ceptor agonist CGS 12066A (0.01-1 pM) in DRN slices inhibits the electrically 
stimulated release of [ 3 H]GABA [180], Application of GABA to serotonergic 
neurons in vitro produces inhibitory postsynaptic potentials in DRN serotoner¬ 
gic neurons [238], These modulatory mechanisms are very important in sleep 
control [239], 

5-HT 1B receptors may also modulate state indirectly by affecting dopami¬ 
nergic function especially in the mesolimbic system [163, 202, 206-210], Both 
a decreased [202, 211, 212] and an increased [213] dopaminergic activity have 
been described after 5-HT 1B receptors manipulation. Changes in activity in the 
dopaminergic mesolimbic system may affect state by shifting motivated behav¬ 
iors (e.g., food seeking) [240], 


Action of 5-HT 1B agonist may also affect state 
by affecting complex behaviors 

5-HT 1B receptors are suggested to be involved in several complex behaviors that 
also may affect state modulation. 5-HT 1B agonists are able to affect anxiety and 
stress sensitivity, change locomotion, decrease food intake, and induce hypo¬ 
thermia, which already has been described in this chapter. All these types of be¬ 
havior indirectly affect wakefulness as discussed in the next three paragraphs. It 
should be noted that the 5-HT 1B receptor is only one of the multiple serotonin 
receptors involved in these behaviors. 


5-HT 1B receptors in stress and anxiety 

An overexpression of 5-HT 1B autoreceptors appears to increase stress-related 
anxiety in the open field test [241, 242], whereas lack of 5-HT 1B receptors as in 
5-HT 1B knockout mice is associated with reduced anxiety [243], However, a study 
has emphasized that 5-HT 1B -mediated changes in locomotor activities may be 
mistaken with anxiety-driven behavior [244], Pharmacological data show that 
the effect from 5-HT 1B activation is ambiguous. Systemic administration of the 
agonist CP 94,253 has shown to increase (1-5.6 mg/kg in rats, [245]) and de¬ 
crease (2.5 mg/kg in mice [246]) anxiety-like behavior in the elevated plus-maze 
test. Tatarczynska and collaborators also report decreased anxiety-like behav¬ 
ior in the conflict drinking test (mice [246]; rats [247]) and in the four-plate test 
(5-10 mg/kg in mice [246]). The anxiolytic effect of the 5-HT 1B antagonists is 
more consistent. Systemic administration of different antagonists in a variety 
of models and species has been shown to decrease anxiety-like behavior. The 
antagonist SB 216641 (2.5 mg/kg) decreases anxiety (measured as the increased 
tolerance to electrical shocks) in the conflict drinking test (mice [246]; rats 
[247]), and also acts as anxiolytic in the elevated plus-maze test (5 mg/kg) and 
in the four-plate test (5-10 mg/kg) (mice [246]). In line with these findings, the 
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newer antagonists SB 616234-A and AR-A000002 produce a dose-related anxio¬ 
lytic effects in several models of anxiety [248, 249], The neuronal mechanism 
that underlies the effects of 5-HT 1B receptors on anxiety is not clearly known. 
Modulation of stress and anxiety states could involve several neuropathways 
in which 5-HT 1B receptors are located at the nerve terminals. An in vitro study 
has shown that the sensitivity of hippocampal 5-HT 1B receptors that inhibit 
the release of [ 3 H]ACh via presynaptic 5-HT 1B heteroreceptors, is reduced by 
restraint stress. These effects were observed with the agonist CP 93,129 [250], 
Intrahippocampal (dorsal CA1 field) microinjections of CP 93,129 (16pg/pl) 
produce anxiogenic behavior as shown by a decrease in locomotor activity and 
a neophobic reaction in response to a new object [251]. 

Another possibility is that 5-HT 1B -mediated response to anxiety is due to the 
5-HT 1B receptors located at the nerve terminals of the amygdalo-periaqueductal 
gray pathway controlling GABA release [252], Stress is thought to be a causal 
factor in the etiology of anxiety and depressive disorders [253], two pathologi¬ 
cal conditions related to altered serotonergic activity. 

In view of 5-HT 1B receptors effect on anxiety-like behavior, it seems plausi¬ 
ble that concomitant changes in state modulation may occur. Such a possibility 
should be considered when interpreting the effect of administration of 5-HT 1B 
ligands on sleep and waking. 


5-HT 1B receptors in locomotor activity 

The abundant localization of 5-HT 1B receptors in motor control centers as 
globus pallidus, substantia nigra and the deep nuclei of cerebellum [153, 254] 
suggests that they are involved in locomotor activity likely by acting on the 
GABAergic projections or via local release of dopamine from dopaminergic 
dendrites (as discussed in a previous section). 

Increased motor activity is usually observed after administration of 5-HT 1B 
agonists [203, 204], Activation of 5-HT 1B receptors after systemic administra¬ 
tion of the agonist RU 24969 (10 mg/kg) [255] and SKF 99101H (20 mg/kg) 
[256] produce an increase in locomotor activity; however, such increase in loco¬ 
motion is unaffected by inhibition of the 5-HT synthesis [255], More selective 
5-HT 1B agonists (5 mg/kg, CP 94,253) [257, 258] and antagonists (7.5 mg/kg, 
SB 216641) [258] do not produce changes in locomotor activity. The 5-HT 1B 
agonist GR 46611 (up to 40 mg/kg s.c.) does not induce locomotor activation 
when given alone; however, it enhances a locomotor response to the 5-HT 1A re¬ 
ceptor agonists 8-OH-DPAT and buspirone [256], Local application of 5-HT 1B 
agonists in the subthalamic nucleus increases locomotor activity (RU 24969 
or CP 93,129). Perfusion of RU 24969 into substantia nigra also induces hy¬ 
perlocomotion, whereas intranigra infusions of CP 93,129 have no effect on 
locomotor activity [259], Intrahippocampal (dorsal CA1 field) stimulation of 
5-HT 1B receptors (16 pg/pl, CP 93,129) induces a decrease in locomotor activity 
[251], Local perfusion of 5-HT 1B agonist (0.1-10 pg, CP 93,129) and antago- 
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nist (0.1-10 pg, GR 55562) in the dopaminergic areas ventral tegmental area 
[260] and nucleus accumbens [258] does not affect locomotor behavior, whereas 
5-HT 1B activation modulates behavioral response to psychostimulants. 5-HT 1B 
knockout mice are observed to be hyperactive during both the light and the 
dark phases [243, 244], 

The observed ambiguous effect of administration of agonists on locomotor 
activity may be a result of an associated behavioral activation. As already con¬ 
sidered for the 5-HT 1A receptors, changes in locomotor activity can affect the 
behavioral state. Increased activity would increase wakefulness at the expense 
of sleep. 


5-HT 1B receptors in food intake 

There is a fairly consistent effect of 5-HT 1B receptors on food intake. Systemic 
administration of 5-HT 1B agonists decreases food intake (e.g., RU 24969, 
mCPP, TFMPP, 0.31-5 mg/kg i.p. [261, 262]; CP 94,253, 2.5 mg/kg [263]; CP 
94,253,5-10 mg/kg [264]). Such appetite-suppressing effects induced by 5-HT 1B 
agonist, and serotonin, are attenuated by 5-HT 1B antagonists (GR 127,935, 
3.0 mg/kg: SB 224289, 2.5 mg/kg [263]; SB 224289, 5 mg/kg: [264]). The hy- 
pophagic effect of systemic administration of 5-HT 1B agonists (RU 24969 and 
TFMPP) seems to be particularly active in female rats [132], Mice lacking the 
5-HT 1B receptor show higher body weight in both male and female compared 
to wild-type mice [265], The suppressive effect of serotonin on carbohydrate 
intake is reported to be blocked by the 5-HT 1B antagonist SB 216641 [266], 
Decreased food intake is also seen after local perfusion of 5-HT 1B agonists in 
hypothalamus; however, the effect depends on the sub-region selected for drug 
administration. Local perfusion of the 5-HT 1B agonist mCPP (1 mM) into ven¬ 
tromedial hypothalamic nucleus reduces food intake [267], This is not observed 
after perfusion into lateral hypothalamic area or frontal cortex. 5-HT was in¬ 
creased by mCCP in all three areas [267], In addition, infusion of the agonists 
TFMPP or RU 24969 (12.5-50 nmol) in medial hypothalamus failed to affect 
food intake [262], Perfusion of the agonist CP 93,129 into the parabrachial 
nucleus of the pons also reduces food consumption in rats [263], while water 
intake, grooming and exploratory activity are unaffected. In the same study, CP 
93,129 decreased food intake, even if with less efficacy, when injected into the 
hypothalamic parabrachial nucleus [263], 

Moreover, in rats deprived of food for 18 h, the 5-HT 1B agonist RU 24969, 
given systemically (1 mg/kg s.c.) or by infusion into the region of the paraven¬ 
tricular nucleus of the hypothalamus (0.5-2.0 pig), induced a dose-dependent 
hypophagia [268], Similar results were obtained with the agonist TFMPP us¬ 
ing the same dosage [268], Activation of 5-HT 1B receptors in paraventricular 
nucleus may control the release of enterostatin (a hormone regulating the in¬ 
take of food rich in carbohydrate) from the amygdala to the paraventricular 
nucleus [269], 
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Consequently, pretreatment with 5-HT 1B antagonist (SB 216641, 2 pg) in 
paraventral nucleus blocked the suppressive effect of 5-HT on carbohydrate in¬ 
take [266], Finally, activation of 5-HT 1B receptors down-regulate hypothalamic 
orexin gene expression in mice [264], Orexin is important in feeding, arousal 
and the maintenance of waking [270], These results suggest a specific role for 
the ventromediale hypothalamic nuclei, paraventral and parabrachial nucleus 
in the food intake suppressant effects of 5-HT 1B agonists. The decreased appe¬ 
tite observed after 5-HT 1B agonists should be considered as a possible confound 
on 5-HT 1B -mediated state modulation. 

5-HT 1B receptors have been linked to other central functions, e.g., learning 
[271] and hormone secretion [272] as well as behavioral and pathological altera¬ 
tions like aggressive behavior [273], drug abuse [274, 206], migraine [275, 276], 
depression [41, 277], impulsive behavior [278], etc. The discussion of these al¬ 
terations cannot be included in the present chapter. 


Conclusions 

The involvement of the 5-HT 1A and the 5-HT 1B receptor in the regulation of 
sleep and waking appears complex. Both receptors produce an important in¬ 
hibitory feed back to the serotonergic raphe neurons. However, due to a multi¬ 
tude of presynaptic and/or postsynaptic actions they also modulate activity in 
other neurotransmitter systems. 

The difference between presynaptic and postsynaptic 5-HT 1A activation is 
evident in the biphasic effect obtained after systemic administration of agonists 
at low or high doses. Overall, most studies support the possibility that stimu¬ 
lation of postsynaptic 5-HT 1A receptors, e.g., via systemic administration of 
agonists (high dose), increases wakefulness and decreases sleep. Local adminis¬ 
tration of agonists in DRN produces a response similar to the “low dose” sys¬ 
temic administration. A specific role of 5-HT 1A receptors is the local inhibition 
of mesopontine REM sleep-promoting neurons, whereas 5-HT 1A -mediated in¬ 
hibition of raphe serotonergic neurons produces a nonspecific decrease of sero¬ 
tonergic function and disinhibition of REM sleep. The existence of other REM 
sleep-promoting areas has been investigated and preliminary studies show that 
modulation of REM sleep may involve more than serotoninergic mechanisms. 

The cortical release of neurotransmitters important for arousal (e.g., ACh, 
and glutamate) appears to be affected in the opposite direction by 5-HT 1B and 
5-HT 1A receptors. However, systemic administration of 5-HT 1B receptors ag¬ 
onists consistently increases wakefulness and decreases REM sleep as do the 
5-HT 1A agonists. Some confusion may arise from the mixed hetero- and autore¬ 
ceptors activation following systemic administration of 5-HT 1B ligands. Thus, 
the mechanism by which 5-HT 1B receptors affect state modulation remains elu¬ 
sive. It should be noticed that both 5-HT IA and 5-HT 1B receptors are involved in 
the control of several behaviors and these functions may indirectly affect state. 
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The general arousing effects of 5-HT 1A and 5-HT 1B agonists should also be con¬ 
sidered in a wider perspective since serotonin is not the only neurotransmitter 
related to wakefulness. Arousal is maintained through the concerted action of 
multiple, largely redundant, neurotransmitter systems. 

Finally, 5-HT 1A and 5-HT 1B receptors are important modulators of the cir¬ 
cadian rhythm largely by affecting the response of the SCN to light and the 
secretion of melatonin from the pineal gland. 

No firm conclusions on the clinical significance of many of these studies can 
be drawn because of the lack of selectivity of the drugs used. The development 
of more selective ligands seems crucial to further explore the role of these re¬ 
ceptors in state modulation. 
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Abstract 

Based on electrophysiological, neurochemical, and neuropharmacological approaches, it is 
currently accepted that serotonin (5-HT) functions to promote waking (W) and to inhibit 
(permissive role) REM sleep (REMS). Serotonergic neurons of the dorsal raphe nucleus 
(DRN) fire at a steady rate during W, decrease their firing during slow-wave sleep (SWS), 
and virtually cease activity during REMS. Serotonin released during W activates 5-HT 1A 
somatodendritic receptors and 5-HT 2A(2C receptors expressed by GABAergic intemeurons, 
and induces a decrease of the firing rate of 5-HT cells characteristic of SWS. In addi¬ 
tion to local inhibitory circuits, GABAergic neurons of the ventrolateral preoptic nucleus 
play a role in the deactivation of the 5-HT and all other arousal systems, which results 
in the occurrence of REMS. Studies on the effects on REMS of direct administration 
of selective 5-HT 1A (8-OH-DPAT, flesinoxan), and 5-HT 2A)2C (DOI) receptor agonists into 
the DRN tend to indicate that quite different mechanisms are involved in their effects. 
Direct infusion of 8-OH-DPAT or flesinoxan into the DRN significantly enhances REMS, 
and this effect is prevented by local infusion of the selective 5-HT 1A receptor antagonist 
WAY 100635. In agreement with the reciprocal interaction hypothesis of REMS genera¬ 
tion, inhibition of DRN serotonergic neurons following somatodendritic 5-HT 1A receptor 
stimulation suppressed 5-HT inhibition of mesopontine cholinergic neurons and increased 
REMS. Infusion of DOI into the DRN induces a significant reduction of REMS in the 
rat. Pretreatment with selective 5-HT 2A and 5-HT 2C receptor antagonists prevents the DOI- 
induced suppression of REMS. Serotonin-containing neurons of the DRN do not express 
5-HT 2A or 5-HT 2C receptors. The 5-HT 2A and 5-HT 2C receptor-containing neurons are pre¬ 
dominantly GABAergic intemeurons and projection neurons. Since DOI inhibits the fir¬ 
ing of serotonergic neurons in the DRN and reduces the extracellular concentration of 
5-HT, it can be proposed that the DOI activation of long-projection GABAergic neurons 
that express 5-HT 2A(2C receptors would be responsible for the inhibition of cholinergic cells 
in the laterodorsal tegmental and pedunculopontine tegmental nuclei (LDT/PPT) and the 
suppression of REMS. Microinjection of 8-OH-DPAT or flesinoxan into the LDT/PPT 
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induces an inhibitory response on target neurons and the suppression of REMS. More¬ 
over, infusion of DOI into the LDT/PPT selectively decreases REMS. In this respect, ac¬ 
tivation of 5-HT 2A/2C receptors expressed by GABAergic interneurons in the LDT/PPT 
would produce the local release of GABA and the reduction of the behavioral state. 


Introduction 

This chapter focuses on the role of serotonin (5-HT)-containing neurons in 
the dorsal raphe nucleus (DRN) in the promotion and induction of rapid- 
eye-movement sleep (REMS) by cholinergic and glutamatergic neurons in the 
laterodorsal and pedunculopontine tegmental nuclei (LDT/PPT) and the me¬ 
dial pontine reticular formation (mPRF), respectively. 

In the 1970s, based on lesion studies and neuropharmacological analysis, 
5-HT was hypothesized to be responsible for the initiation and maintenance 
of slow-wave sleep (SWS) [1], In this respect, lesioning of the area where 
5-HT-containing cells are located, or reduction of brain 5-HT by p-chlorophe- 
nylalanine (PCPA), was found to increase wakefulness (W) and to reduce sleep 
[2-4], However, interpretation of the results obtained after lesioning the 5-HT- 
containing neurons in the brainstem is hampered by the lack of selectivity of 
electrolytic lesions. Moreover, PCPA is not completely selective for tryptophan 
hydroxylase; it interferes also with the activity of tyrosine hydroxylase, which 
is involved in the synthesis of norepinephrine (NE) [5], In addition, this 5-HT 
synthesis inhibitor induces increased responsiveness to noxious or neutral envi¬ 
ronmental stimuli and enhances motor activity, aggressivity, and sexual activity 
[6-9], The shortcomings of the early studies clearly showed that more efficient 
methods were needed to elucidate the role of 5-HT in sleep. 

Subsequently, electrophysiological recordings across the sleep-wake cycle 
showed that serotonergic DRN neurons are more active during W, diminish 
their activity during SWS, and virtually cease activity during REMS [10], Simi¬ 
larly, 5-HT release in the brain is maximal during W, decreases during SWS, and 
is minimal during REMS [11], Based on such electrophysiological approaches 
and, in addition, on neurochemical, and neuropharmacological approaches, it 
is currently accepted that 5-HT functions to promote W and to inhibit REMS. 


Brainstem structures involved in the promotion 
and generation of REMS 


On the grounds of studies in which the cholinergic agonist carbachol was mi- 
croinjected into rostral pontine structures of the cat, it has been proposed that 
the critical area for REMS generation could be one or more of the following: 
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(1) the most ventral and rostral part of the pontine reticular nucleus [12]; (2) 
the perilocus coeruleus alpha nucleus (peri-LCa) of the mediodorsal pontine 
tegmentum [13]; (3) the dorsal part of the rostral pontine tegmentum [14]; (4) 
the medial pontine reticular formation (mPRF), which encloses the rostral 
and caudal part of the pontine reticular nucleus and dorsally reaches the lo¬ 
cus coeruleus alpha (LCa) [15], or (5) the ventral part of the pontine reticular 
nucleus [16], 

The reciprocal interaction hypothesis of REMS generation identifies cho¬ 
linergic neurons in the laterodorsal tegmental and pedunculopontine tegmen¬ 
tal nuclei (LDT/PPT) as promoting REMS and posits the inhibition of these 
neurons by, among others, serotonergic afferents from the DRN [17, 18], The 
REMS induction region of the mPRF, one of the neuroanatomical structures 
proposed to be responsible for REMS generation, includes predominantly glu- 
tamatergic neurons, which are in turn activated by efferent connections of the 
LDT/PPT 

Although moderate to dense serotonergic projections of the DRN and 
the median raphe nucleus (MRN) have been observed to reach the LDT/PPT 
and the REMS induction zone of the mPRF, the DRN provides the principal 
source of 5-HT innervation to these structures [19-21], In this respect, sero¬ 
tonergic terminals have been characterized that make synaptic contacts with 
the soma and the proximal dendrites of cholinergic tegmental neurons labeled 
with choline-acetyltransferase (ChAT), and with non-cholinergic, presump¬ 
tively glutamatergic, neurons of the REMS induction zone of the mPRF [22, 
23], The DRN also sends ascending non-serotonergic projections to the LDT/ 
PPT [24-27], 


The structure of the DRN and of the PPT 

Steinbusch [28] has shown that 5-HT cells in the rat DRN appear in topograph¬ 
ically organized groups, which include dorsomedial, ventromedial, and lateral 
subdivisions. These subpopulations of neurons differ in their morphological 
characteristics, cellular properties, and afferent and efferent connections [29], 
In addition, neurons containing dopamine, glutamate, y-aminobutyric acid 
(GABA), substance P, and corticotrophin-releasing factor are present in the 
DRN [30-33], Of these non-5-HT DRN cells, the GABAergic ones are of spe¬ 
cial relevance to our topic because of their role in the inhibition of 5-HT neu¬ 
rons during REMS. 

In this respect, Allers and Sharp [34] recognized fast- and slow-firing neurons 
in the DRN of urethane-anesthetized rats. The slow-firing cells were immuno- 
reactive for 5-HT and/or tryptophan hydroxylase (TrH), and were distributed 
throughout the rostral-caudal extent of the DRN. Intravenous administration of 
the serotonin 5-HT 1A receptor agonist 8-hydroxy-2-(di-n-propylamino)tetralin 
(8-OH-DPAT) inhibited the activity of the slow-firing cells. The fast-firing neu- 
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rons were immunoreactive for glutamic acid decarboxylase (GAD), the enzyme 
that catalyzes the synthesis of GABA, and immunonegative for TrH, and were 
predominantly located in the lateral subdivisions of the DRN. 

Subsequently, Urbain et al. [35] identified two major types of DRN neurons 
in non-anesthetized, head-restrained rats. One type of neuron was character¬ 
ized by broad, mostly positive spikes, whereas the other displayed symmetrical 
positive-negative spikes. The activity of cells that fired broad spikes was at its 
highest during W; it decreased during SWS, and was virtually suppressed dur¬ 
ing REMS. These cells have been considered serotonergic. On the other hand, 
the majority of the cells that displayed symmetrical positive-negative spikes 
were active during W and sleep. Some of these neurons fired at even higher 
rates during SWS and REMS. Urbain et al. [35] have proposed that the latter 
group of cells may represent GABAergic interneurons. 

In the PPT of the rat, Takakusaki et al. [36] characterized two types of neu¬ 
rons according to their action potential duration: short-duration and long-du¬ 
ration neurons. Of the short-duration neurons, 56% were immunopositive for 
ChAT and of long-duration neurons, 61%. The fast-firing neurons had higher 
firing rates during W and REMS than during non-REM sleep (NREMS). In 
contrast, the slow-firing cells increased their firing rates from W to NREMS, 
and still more during REMS. The subset of cells that discharge predominantly 
during W and REMS is referred to as Wake/REM-on neurons, whereas the sub¬ 
set of cells whose discharge is greatest during REMS is known as the REM-on 
neurons [37], This finding correlates with reports describing increased release 
of acetylcholine (ACh) in the brainstem during desynchronized sleep [38], 


Operational characteristics of the 5-HT 1A and the 5-HT 2 
receptors 


The 5-HT receptors can be classified into at least seven classes, designated 
5-HT,_ 7 . The 5-HTj, 5-HT 2 , and 5-HT s classes consist of five (5-HT IA I! DEI ), 
three (5-HT 2A 2B 2C ), and two (5-HT SA 5B ) subtypes, respectively, whereas the 
5-HTj, 5-HT 4 , 5-HT 6 , and 5-HT 7 classes have at present one receptor each [39- 
41], Except for the 5-HT 3 receptor, all other 5-HT receptors are structurally 
related to the superfamily of G protein-coupled receptors. Presently available 
evidence tends to indicate that the receptors implicated in the regulation of 
REMS are 5-HT 1A , 5-HT 2A and 5-HT 2C . 

The 5-HT 1A receptor is located on the soma and the dendrites (somatoden¬ 
dritic autoreceptor) of 5-HT neurons, and at postsynaptic sites. Wang and 
Aghajanian [42] and Aghajanian and Lakoski [43] have shown that the somato¬ 
dendritic autoreceptor mediates collateral inhibition, and that the ionic basis 
for inhibition is the opening of K + channels and closing of Ca 2+ channels to 
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produce hyperpolarization. The 5-HT 1A receptor is coupled to adenylate cy¬ 
clase. Its activation inhibits the enzyme, which could be related to the coupling 
of the 5-HT 1A receptor to a Gi protein. Stimulation of the somatodendritic 
5-HT 1A receptor inhibits the firing rate of serotonergic neurons, whereas activa¬ 
tion of the postsynaptic receptor induces inhibitory responses on target struc¬ 
tures. Brain areas rich in 5-HT 1A receptors include the LDT/PPT and the raphe 
nuclei, particularly the DRN [44,45], 

The 5-HT 2 subfamily comprises three receptor subtypes: 5-HT 2A 5-HT 2B , 
and 5-HT 2C Unlike 5-HT 2A and 5-HT 2C receptor-like immunoreactivity, which 
is distributed throughout the CNS, 5-HT 2B receptors are expressed in discrete 
brain nuclei in the rat that are not relevant to sleep-wake regulation [46], The 
5-HT 2A and 5-HT 2C receptors have striking amino acid homology, and their 
actions are mediated by the activation of phospholipase C, with a resulting 
depolarization of the host cell [47, 48], Receptors of the 5-HT 2 subfamily are 
located within postsynaptic cells. 5-HT 2A receptor mRNA has been reported 
in the DRN, the LDT/PPT, and the mPRF, and its distribution is generally in 
good agreement with that of the corresponding binding sites [49-51], 5-HT 2C 
receptor mRNA has also been found in the DRN and the pontine nuclei [26, 
52, 53], However, DRN serotonergic and LDT/PPT cholinergic cells do not ex¬ 
press 5-HT 2a(2C receptors. The DRN and LDT/PPT neurons that express these 
receptors are mainly inhibitory GABAergic interneurons [50], 


Mechanisms involved in the regulation of the activity of DRN 
serotonergic neurons during sleep and waking 


Axon collaterals of ascending 5-HT fibers exert a negative feedback influence 
impinging directly upon 5-HT 1A somatodendritic autoreceptors. Another feed¬ 
back loop involves GABAergic interneurons synapsing on 5-HT cells that ex¬ 
press GABA a receptors. There is no agreement among investigators as to the 
location of the GABA-containing cells in the DRN. According to Nanopoulos 
et al. [54] and Belin et al. [55], GABAergic cells would be intermingled with 
5-HT neurons throughout the DRN. On the other hand, Mugnaini and Oertel 
[56] and Ford et al. [25] contend that GABAergic neurons are confined to the 
periphery of the nucleus. 

Activation of 5-HT 1A autoreceptors and 5-HT receptors expressed by GA¬ 
BAergic interneurons depends upon the local release of 5-HT. Consequently, 
the reduction of the firing of 5-HT cells through local circuits starts occurring 
during W. In other words, serotonin released during W will activate 5-HT 1A so¬ 
matodendritic autoreceptors and 5-HT 2A;2C receptors expressed by GABAergic 
interneurons and will induce a decrease of the firing rate of 5-HT cells charac¬ 
teristic of SWS. However, selective deactivation of the serotonergic system is 
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not sufficient to cause an increase of SWS [57, 58], For SWS to increase, NE-, 
histamine (HA)-, ACh-, and orexin (OX)-wake-active neurons must also at¬ 
tenuate their discharges [59], Hence, cell groups that cause arousal are partially 
redundant, and deactivation of any one of them does not lead to an increase of 
SWS occurrence (Fig. 1). In addition to local inhibitory circuits, GABAergic 
neurons of the ventrolateral preoptic nucleus (VLPO) play a role in the SWS- 
conducive deactivation of these multiple arousal systems. 

GABAergic neurons have been found in the VLPO that project to the brain¬ 
stem systems that promote W [60, 61]. The firing rate of GABAergic neurons 
found within the VLPO dense cell cluster and the extended VLPO is enhanced 
during SWS and REMS, respectively. On the other hand, lesions of the VLPO 
cluster induce a marked reduction of SWS, whereas lesions of the extended 
VLPO suppress REMS [61, 62], The GABAergic cells of the VLPO are inhib¬ 
ited by DRN 5-HT neurons. In turn, the VLPO sends axons that inhibit the 
5-HT cells [63] (Fig. 2). The partial decrease of the firing rate of 5-HT neurons 
during SWS contributes to the disinhibition of VLPO GABAergic neurons and 
the increase of GABA release in the DRN, with the resulting inactivation of 
5-HT cells and REMS. The findings that 5-HT neurons in the DRN are inhib¬ 
ited by GABA a receptor activation [64], and that the extracellular concentra¬ 
tion of GABA in the DRN rises predominantly during REMS compared with 
SWS [65], tend to indicate that GABAergic mechanisms have a predominant 
role in the occurrence of REMS. 

This relationship of mutual inhibition between the VLPO GABAergic cells 
and the neurons involved in the maintenance of W led Saper and coworkers to 
propose the flip-flop switch hypothesis of regulation of sleep and W. Accord¬ 
ing to the flip-flop switch hypothesis, when the arousal systems tend to pre¬ 
dominate, they shut off the GABAergic system and increase their own activity, 
which is manifested by an enhancement of the firing rate of the corresponding 
cells; the opposite occurs when the VLPO GABAergic neurons tend to prevail 
[66-68], A flip-flop switch has been proposed also by Lu et al. [69] for the con¬ 
trol of REMS. In this respect, the main switching mechanism would involve 
mutually inhibitory interactions between GABAergic REM-off and REM-on 
cells of the mesopontine tegmentum. 

Many GABAergic neurons in the DRN contribute to long projections that 
reach the LDT/PPT nuclei [25], However, the role of this additional circuitry in 
the regulation of sleep is still a matter of debate. Intra-raphe or microiontopho- 
retic administration of the 5-HT 2A/2C receptor agonist DOI inhibits the firing of 
serotonergic neurons in the DRN and reduces the extracellular concentration 
of 5-HT [70], Notwithstanding the above, microinjection of DOI into the DRN 
results in the suppression of REMS, which tends to suggest that activation of 
long-projection GABAergic neurons by DOI inhibits the activity of cholinergic 
cells in the LDT/PPT nuclei and decreases REMS [71]. Thus, long-projection 
GABAergic neurons expressing 5-HT 2A(2C receptors are activated during W and 
suppress REMS (Fig. 3). During SWS, these cells decrease their inhibitory ac- 
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Fig. 1 Schematic drawing of the dorsal raphe nucleus of the rat illustrating the inhibi¬ 
tion of a serotonergic neuron by 5-HT released during waking. The activation of 5-HT 1A 
somatodendritic autoreceptors and 5-HT 2A(2C receptors expressed by GABAergic inter¬ 
neurons induces a decrease of the firing rate of the serotonergic cells characteristic of 
slow wave sleep. 5-HT, serotonin; GABA, y-aminobutyric acid 



VLPO 

Fig. 2 Schematic drawing showing the mutual inhibition between the ventrolateral pre¬ 
optic nucleus GABAergic cells and the dorsal raphe nucleus serotonergic neurons. DRN, 
dorsal raphe nucleus; VLPO, ventrolateral preoptic nucleus 
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5-HT2A/2C receptor 
I 



DRN LDT 


Fig. 3 Schematic drawing of the dorsal raphe nucleus and the laterodorsal tegmen¬ 
tal nucleus (LDT) of the rat illustrating the inhibition of a cholinergic neuron by a 
GABAergic long-projection cell (DRN) and a GABAergic interneuron (LDT) expres¬ 
sing 5-HT 2A)2C receptors 


tion, which allows REMS to occur. Therefore, from a functional point of view, 
two types of GABAergic cells are found in the DRN: GABAergic intemeurons, 
which contribute to the decrease of the activity of 5-HT neurons during SWS, 
and long-projection GABAergic neurons, which suppress REMS. It should be 
mentioned that serotonergic inhibition of REMS involves not only the activa¬ 
tion of GABA a receptors expressed by LDT/PPT cholinergic neurons but also 
the activation of postsynaptic 5-HT 1A receptors. 


Serotonergic influences on the LDT cholinergic and the mPRF 
glutamatergic neurons 


Luebke et al. [72] determined the effects of 5-HT and of the nonselective 5-HT t 
receptor agonist carboxamidotryptamine (5-CT) on cholinergic rat LDT nu¬ 
cleus neurons in vitro. Serotonin hyperpolarized the majority of cholinergic 
bursting neurons, and this effect was mimicked by 5-CT. These findings give 
support to the inhibitory role exerted by 5-HT on cholinergic REMS-promot- 
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ing neurons. To test the hypothesis that 5-HT at the LDT nuclei suppresses 
REMS in vivo, Horner et al. [73] implanted rats with bilateral cannulae aimed 
at the cholinergic structures. As hypothesized, microinjection of 5-HT into the 
LDT decreased REMS as a percentage of total sleep time in a dose-dependent 
manner. 

The action of 5-HT on mPRF neurons was examined in rat brainstem slices 
in vitro. Application of 5-HT resulted in a hyperpolarization in 34% of the neu¬ 
rons. This response was mimicked by 5-CT and 8-OH-DPAT, and was blocked 
by the 5-HT, antagonist spiperone [74], Interestingly, a separate population of 
mPRF cells, tentatively GABAergic intemeurons, was depolarized by 5-HT. 
The depolarization was mimicked by the 5-HT 2 receptor agonist a-Me-5-HT, 
and was blocked by the 5-HT 2 receptor antagonist ketanserin. Compound 
5-CT had no effect on neurons that were depolarized by a-Me-5-HT [74], These 
findings tend to indicate that 5-HT acting on at least two distinct receptors on 
neurons of the mPRF, postsynaptic 5-HT 1A receptors and 5-HT 2A/2C receptors 
expressed by GABAergic interneurons, will inhibit cells involved in the induc¬ 
tion of REMS. 


Effects of microdialysis perfusion or direct infusion 

of a 5-HT 1A receptor agonist into the DRN, LDT, or mPRF 

on REMS occurrence 

Flesinoxan and 8-OH-DPAT, two full agonists of 5-HT 1A receptor pre- and 
postsynaptic sites, and the selective high-affinity silent antagonists WAY 100635 
and p-MPPI have been used to characterize the role of 5-HT 1A receptor in the 
regulation of REMS. 

Portas et al. [75] provided direct evidence that suppression of DRN seroto¬ 
nergic activity increases REMS. In this study, extracellular 5-HT was measured 
in the DRN and, simultaneously, behavioral state changes were determined 
from polygraphic recordings. Microdialysis perfusion of 8-OH-DPAT into 
the DRN decreased 5-HT levels by 50% during W and significantly increased 
REMS. Moreover, direct infusion of either 8-OH-DPAT or flesinoxan into the 
DRN significantly enhanced REMS in rats, and this effect was prevented by lo¬ 
cal infusion of WAY 100635 [58], In contrast, microinjection of WAY10035 or 
p-MPPI into the DRN reduced REMS [57, 58, 76]. 

Microinjection of 8-OH-DPAT or flesinoxan into the LDT or the mPRF, 
where structures that act to promote and to induce REMS are located, selec¬ 
tively inhibited REMS in the cat and the rat [73, 77, 78], On the other hand, 
direct infusion of WAY100635 into the LDT increased REMS [79], 

It can be concluded that direct administration of a 5-HT 1A receptor agonist 
into the DRN inhibits serotonin-containing neurons and enhances REMS. In¬ 
terestingly, cell groups that inhibit REMS during W do not seem to be redun- 
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dant with respect to this behavioral state, because deactivation of one of them, 
the 5-HT system, induces an increase of REMS. Infusion of 5-HT 1A agonists 
into areas in which the cholinergic or the glutamatergic REMS-induction neu¬ 
rons are located results in the suppression of REMS. The inhibitory effect of 
postsynaptic 5-HT 1A receptor activation on REMS occurrence is further sup¬ 
ported by studies carried out in mutant mice that do not express this receptor 
subtype [80], Accordingly, REMS was significantly increased during both the 
light and the dark phase in 5-HT 1A -knockout mice compared with wild-type 
animals. Furthermore, systemic 8-OH-DPAT had no effect on sleep or W in 
these mutant mice. 


Effects of direct infusion of a 5-HT 2A/2C receptor agonist 
into the DRN or LDT on REMS occurrence 


As mentioned earlier, infusion of DOI into the DRN induced a significant re¬ 
duction of REMS and of the number of REM periods in the rat. Following 
the microinjection of the selective 5-HT 2A or 5-HT 2C receptor antagonists EMD 
281014 and SB-243213, respectively, light sleep was slightly but significantly 
augmented. Pretreatment with EMD 281014 or SB-243213 prevented the DOI- 
induced suppression of REMS, which indicates that it was mediated by the 
5-HT 2A and 5-HT 2C receptors located in the DRN [71]. Systemic, intra-raphe, 
or microiontophoretic administration of DOI inhibits the firing of serotoner¬ 
gic neurons in the DRN and reduces the extracellular concentration of 5-HT 
[70], The reduction of the firing rate of 5-HT neurons in the DRN of the rat 
after systemic injection of DOI is reversed by the 5-HT 2A receptor antagonist 
MDL 100,907 or the GABA a antagonist picrotoxinin [81]. In rat brain slices, 
the 5-HT- or DOI-induced increase of the frequency of inhibitory postsynap¬ 
tic currents in serotonergic neurons of the DRN is prevented to a large extent 
by the 5-HT 2A receptor antagonist MDL 100,907 and by the GABA a receptor 
antagonist bicuculline, whereas the 5-HT 2C receptor antagonist SB 242,084 is 
less effective in this respect [82], As discussed earlier, the DOI activation of 
long-projection GABAergic neurons that express 5-HT 2A/2C receptors would be 
tentatively responsible for the inhibition of cholinergic cells in the LDT/PPT 
nuclei and the suppression of REMS. 

Amici et al. [83] locally microinjected DOI or the 5-HT 2 receptor antagonist 
ketanserin into the LDT of rats. DOI significantly decreased the number of 
REMS episodes, whereas ketanserin induced the opposite effect. The finding 
by Fay and Kubin [50] that 5-HT 2A/2C receptors are located not on cholinergic 
cells but on GABAergic intemeurons intermingled with mesopontine cholin¬ 
ergic cells tends to explain the inhibitory effect of DOI on cholinergic LDT 
neurons and the reduction of REMS episodes. 
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Conclusions 

It is currently accepted that serotonin functions to promote W and to inhibit 
REMS. Attempts to characterize the effects of locally administered serotonin 
receptor ligands on DRN, LDT/PPT, and mPRF neurons have been limited to 
the 5-HT 1A , 5-HT 2A , and 5-HT 2C receptors. 

It has been established that 5-HT cells in the rat DRN appear in topo¬ 
graphically organized groups. These subpopulations of neurons differ in their 
morphological characteristics, cellular properties, and afferent and efferent 
connections. Thus, the possibility exists that efferent projections from each sub¬ 
population of 5-HT neurons form synapses with only one subtype of serotonin 
receptor. This would allow different 5-HT subsystems to influence specifically 
and separately the neurons involved in the regulation of REMS. 

Serotonergic neurons of the DRN lire at a steady rate during W, decrease 
their firing during SWS, and virtually cease activity during REMS. Serotonin re¬ 
leased during W activates 5-HT 1A somatodendritic autoreceptors and 5-HT 2A(2C 
receptors expressed by GABAergic interneurons, and induces a decrease of the 
firing rate of 5-HT cells characteristic of SWS. In addition to local inhibitory 
circuits, GABAergic neurons of the VLPO play a role in the deactivation of the 
5-HT and all other arousal systems, which results in the occurrence of REMS. 

Many DRN GABAergic neurons that express 5-HT 2A/2C receptors contribute 
to long projections that reach the LDT/PPT. The activation of long-projection 
GABAergic neurons during W induces the inhibition of cholinergic cells of 
the LDT/PPT and the suppression of REMS. Of note, postsynaptic 5-HT 1A 
receptors are simultaneously activated and contribute to the inhibition of this 
behavioral state. 

Microinjection of the 5-HT 1A receptor ligands 8-OH-DPAT or flesinoxan 
into the DRN increases REMS in the rat. Direct administration of either of 
these 5-HT 1A agonists into the LDT or the mPRF induces the opposite effect. 
Moreover, infusion of the 5-HT 2A/2C receptor agonist DOI into the DRN or the 
LDT selectively decreases REMS. 

Thus, activation of the postsynaptic 5-HT 1A receptor induces an inhibitory 
response on target neurons of the LDT/PPT and the suppression of REMS. 
Moreover, activation of 5-HT 2A(2C receptors expressed by GABAergic interneu¬ 
rons in the LDT/PPT produces the local release of GABA and the reduction 
of REMS. 
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Abstract 

Several lines of evidence including human and rodent sleep studies with receptor ligands, 
data from genetically modified mice, and the localization of receptors in key brain struc¬ 
tures suggest the important role of 5-HT 2 receptors in the regulation of vigilance. There 
are three members of the 5-HT 2 receptor family: the 5-HT 2A , 5-HT 2B and 5-HT 2C receptors. 
Their distribution in the brain as well as their functions in sleep regulation show consider¬ 
able differences. In summary, activation of 5-HT 2A receptors results in an increase, and 
activation of 5-HT 2B receptors causes a decrease in waking. Tonic activation of 5-HT 2A re¬ 
ceptors by endogenous 5-HT effectively inhibits slow wave sleep. Subtype-selective 5-HT 2C 
receptor agonists cause an increase in waking, while the 5-HT 2C receptor antagonists have 
little effect. In the case of none subtype-selective compounds, the 5-HT 2A receptor-medi¬ 
ated effects usually dominate the outcome on sleep-wake stages and thus, inhibition of 
non-REM (and also REM) sleep could be expected after administration of selective se¬ 
rotonin reuptake inhibitor antidepressants, while activation of slow-wave sleep could be 
observed after 5-HT 2 receptor antagonist antidepressants and atypical antipsychotic com¬ 
pounds, although high affinity to other, e.g., cholinergic or adrenergic receptors may mask 
the outcome in certain cases. Compounds with high affinity to 5-HT 2 receptors (either 
agonists or antagonists) reduce REM sleep in general. 


388 


Tamas Kitka and Gyorgy Bagdy 


Localization and cellular function of 5-HT 2A , 5-HT 2B 
and 5-HT 2C receptors related to sleep regulation 


Several lines of evidence suggest the role of 5-HT 2 receptors in the regulation 
of vigilance. There are three members of the 5-HT 2 receptor family: the 5-HT 2A , 
5-HT 2B and 5-HT 2C receptors (formerly known as 5-HT 2 , 5-HT 2F and 5-HT lc , 
respectively). All of them are G protein coupled, but there are some differences 
in their amino acid sequence and signaling cascade (see later). Their distribu¬ 
tion in the brain as well as their functions show considerable differences. 


5-HT 2 receptor signaling 

All three type of 5-HT 2 receptors are coupled with Gaq proteins, and can, there¬ 
fore, activate phospholipase C (PLC) [1], This generates the second messenger, 
inositol triphosphate (IP 3 ) by hydrolyzing phosphatidylinositol bisphosphate 
and finally produces the activation of protein kinase C (PKC), mobilization of 
intracellular Ca 2+ and influx of extracellular Ca 2+ [1], 

5-HT 2 receptors also stimulate phospholipase A 2 (PLA 2 ), leading to extra¬ 
cellular calcium-dependent release of arachidonic acid (AA) [2], These two 
cascades seem to be independent, and different agonists stimulate these two 
signaling pathways in a different rate (e.g., 3-trifluoromethylphenyl-piperazine 
mainly effects on PLC-IP 3 pathway, while lysergic acid diethylamide is more ef¬ 
fective on the PLA 2 -AA cascade) [2, 3], 

Phospholipase D (PLD) can also be activated by 5HT 2C receptors through 
Got and free G(3y subunits. That has been demonstrated in rat choroid plexus 
epithelial cells, but has not been confirmed in neurons yet [4], 

Binding of serotonin to postsynaptic 5-HT 2 receptors causes excitatory post- 
synaptic potential (EPSP) by a decrease in the potassium conductance [5-7] 
and PKC may have negative feedback role in that process [8], 


Distribution of 5-HT 2A , 5-HT 2B and 5-HT 2C receptors in the brain 

5-HT 2A receptors in mammals are present in the telencephalon [olfactory sys¬ 
tem, cerebral cortex, basal forebrain (BF), neostriatum, hippocampus, amyg¬ 
dala], in the diencephalon (dorsal thalamus, hypothalamus), in the mesen¬ 
cephalon [superior colliculus, ventral tegmental area (VTA), substantia nigra 
pars reticulata (SNr), peduncolopontine tegmental nucleus (PPT), laterodorsal 
tegmental nucleus (LDT)], and in the myencephalon (spinal trigeminal nucleus, 
nucleus tractus solitarius, spinal cord motor, sympathetic and sensory neurons) 
[1], Brain areas that receive projections from the dorsal raphe nucleus (DRN) 
also show 5-HT 2A immunostaining [9], 5-HT 2A immunostaining is also found in 
the suprachiasmatic nucleus (SCN) but it is thought to be present in astrocytes, 
not neuronal elements [10], 
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5-HT 2A receptors are present on the neurons of VTA, and they can have 
either axonic or dendritic localization. Approximately 40% of 5-HT 2A -immu- 
nopositive dendrites are located on dopaminergic VTA cells [11], 

Cholinergic neurons of LDT and PPT were found to express 5-HT 2 receptors 
[12], In contrast, Fay and Kubin described 5-HT 2A immunostaining on smaller, 
non-cholinergic cells, presumably local GABAergic inhibitory interneurons. In 
their studies, cholinergic cells were stained with anti-NO synthase (NOS), as 
NOS is a marker for cholinergic cells, and they did not find colocalization of 
NOS and 5-HT 2A receptors [9], There is evidence for a difference in the seroto¬ 
nergic regulation in the two populations of the cholinergic LDT and PPT cells, 
the REM-on and the REM-and-wake-on neurons, as the latter cells also fire 
during wake, when the serotonergic system is active. In accordance, REM-and- 
wake-on neurons are not inhibited by serotonergic DRN cells, and therefore the 
presence of excitatory 5-HT 2 receptors on these neurons is physiologically pos¬ 
sible, while REM-on neurons presumably do not express excitatory serotonin 
receptors. We propose that other serotonin receptors, e.g., inhibitory 5-HT 1A or 
5-HT 1B , also take part in the serotonergic regulation of REM-on and REM- 
and-wake-on cholinergic neurons, and the presence of these two, neurochemi- 
cally and functionally different cell populations may give a explanation for the 
contradiction between the two articles cited above, although further studies are 
needed to elucidate the localization of 5-HT 2 receptors on these two neuron 
populations. 

The BF, LDT, PPT and DRN all have a fundamental role in the regulation 
of the sleep-wake cycle; furthermore, the VTA and SN also show a circadian 
rhythm, so the role of 5-HT 2A receptors in the regulation of the sleep-wake 
cycle is also supported by their distribution in the brain. 

5-HT 2B receptors have been found in the medial amygdala, lateral septum 
(LS), dorsal hypothalamus and in discrete nuclei of the cerebellum in the hu¬ 
man brain [1], but it is thought to be absent in the rat brain. However, low levels 
of the 5-HT 2B receptor mRNA have been detected in mouse brain [13], By per¬ 
forming immunohistochemistry with antiserum raised against the 5-HT 2B re¬ 
ceptor protein, the expression of the receptor has been identified in both mouse 
[14] and rat [15] brains. In the mouse, immunoreactivity was mostly found in the 
cerebellum, but lower levels were also present in the hippocampus [14], while in 
the rat the presence of the 5-HT 2B receptor has been demonstrated in discrete 
nuclei in the cerebellum, LS, dorsal hypothalamic nucleus (DHN) and medial 
amygdala [15]. The LS and dorsal hypothalamus take part in controlling the 
circadian rhythms. The presence of 5-HT 2B receptors in the rodent brain was 
further supported by the role of this subtype in the regulation of the sleep- 
wake cycle that has been confirmed in pharmacological studies [16]. 

In the rat, the highest density of 5-HT 2C receptors can be found in the epi¬ 
thelial cells of the choroid plexus, but high levels of 5-HT 2C receptor protein are 
also present in several brain areas: in the olfactory system, cerebral cortex, the 
hippocampal formation, basal ganglia, amygdala, LS, several thalamic nuclei 
including the geniculate nuclei, ventromedial and medial mamillary nuclei of 
the hypothalamus, several mesencephalic nuclei including the substantia nigra 
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pars compacta (SNc), cerebellum, myencephalon, and in the spinal cord [17, 
18]. The distribution of 5-HT 2C mRNA in the human brain shows the high¬ 
est density of 5-HT 2C mRNA in the epithelial cells of the choroid plexus, 
but labeling is also found in the layer V of the neocortex, the CA3 region 
of the hippocampus, the caudatoputamen, the SNc, the periventricular and 
ventromedial hypothalamus. However, in contrast with the distribution in the 
rat brain, there was no labeling in cerebellum [19]. 5-HT 2C mRNA is found 
in several brain areas in which cathecholaminergic and cholinergic neurons 
are also present, suggesting that this receptor takes part in the serotonergic 
regulation of the cathecholaminergic and cholinergic systems. These areas are 
the locus coeruleus (LC, noradrenaline), retro rubical area, substantia nigra 
(SN), VTA, periaqueductal gray (dopamine), basal nucleus of Meynert, para 
bigeminal nucleus, LDT (acetylcholine) [1], 5-HT 2C receptors frequently occur 
on GABAergic neurons. 5-HT 2C receptors in the dorsal [20] and anterior [21] 
raphe nuclei, the SN [22, 23], and neurons of the VTA expressing 5-HT 2C recep¬ 
tors are presumed to be GABAergic [24] as well. A selective 5-HT 2C receptor 
agonist caused an excitation in about half of the tested GABAergic neurons of 
SNr [25], 

GABAergic cells of the nucleus reticularis thalami also express 5-HT 2C re¬ 
ceptors [26], These neurons project to nonspecific thalamic relay cells, thus they 
play a crucial role in the regulation of the thalamocortical transmission. 

The LC and LDT have a fundamental role in regulating the sleep-wake cycle, 
and pharmacological studies also revealed the role of 5-HT 2C receptors in the 
regulation of slow wave sleep (SWS) in humans [27], and hippocampal theta 
oscillation in rat [28, 29], 


Sleep patterns of mice lacking 5-HT 2 receptors 

There are only a few sleep studies on serotonin 2 receptor knockout mice. Mice 
lacking 5-HT 2A receptor showed increased wake, and decreased non-REM 
(NREM) sleep compared to wild-type mice. In contrast, blockade of 5-HT 2A 
receptors of wild-type mice by MDL 100907, a selective 5-HT 2A receptor antag¬ 
onist resulted in decreased wakefulness and increased NREM (see below) [30], 
The discrepancy between the sleep pattern of knockout animals and the wild- 
type animals with a 5-HT 2A receptor blockade may be caused by the changes in 
the activity of other receptors in the mutants, namely the role of 5-HT 2B and 
5-HT 2C receptors in the regulation of sleep seems to be reduced or enhanced, 
respectively [30], The mean duration of wake episodes were also lengthened 
during the dark phase in the 5-HT 2A -knockout mutants compared to wild-type 
mice [30], MDL 100907 did not alter the sleep pattern of 5-HT 2A receptor- 
knockout animals [30], 

5-HT 2C receptor-knockout mice showed very similar changes to 5-HT 2A _ 
knockout mutants compared to wild-type animals. Decreased NREM, in- 
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creased wake (particularly at the dark phase), and longer wake episodes were 
noticeable [31]. This topic is covered in more details in the chapter by Adrian. 


Sleep effects of drugs acting on the 5-HT 2 receptors 

The affinity values of 5-HT 2 receptor agonist and antagonists for serotonin 2 
receptor subtypes and some other receptors are summarized in Table 1, but the 
basic pharmacological properties of these compounds are also indicated in the 
text. 


Table 1 Affinities of the 5-HT 2 receptor agonist and antagonist compounds to different 
neurotransmitter receptors. Most values are pK i; other values are marked with alphabe¬ 
tic upper indexes (■: pEC 50 , b :pIC 50 , c : pID S0 , d: pK„). References are indicated with numeric 
upper indexes and the codes are given below the table. not determined. 


Compound 

Function 

5-HT 2i 

5-HT 2B 

5-HT 2C 

Other receptors 

5-MeOT® 

Agonist 

7.4* 

8.8* 

6.2" 


a-Methyl-5-HT® 

Agonist 

6.1* 

8.4* 

7.3* 


AT-1015® 

Antagonist 

7.94 

- 

- 


BW 723C86® 

Agonist 

6.66* 

8.97* 

7.0* 


Clozapine® 

Antagonist 

8.02 

- 

7.89 

5-HT 6 : 8.40; a2C: 8.04; 

HI: 9.64 

DOB® 

Agonist 

9.50 

- 

8.22 


DOI® 

Agonist 

7.3* 

7.4* 

7.8* 


DOM® 

Agonist 

8.44 

- 

7.44 


EMD 281014/Pru- 

vanserin® 

Antagonist 

9.0" 

- 

5.88* 

a: 6.16" 

ICI169369® 

Antagonist 

7.75 

- 

- 


ICI170809® 

Antagonist 

9.1 

- 

8.3 


IL 639® 

Agonist 

- 

6.68 

8.00 


I-R91150 / R93274® 

Antagonist 

9.66 

- 

7.87 


Ketanserin® 

Antagonist 

8.9 

5.4 

7.0 



Code for references: 1: [40]; 2: [1]; 3: [70]; 4: [71]; 5: [72]; 6: [73]; 7: [74]; 8: [75]; 9: [44]; 10: 
[30]; 11: [76]; 12: [77], 
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Table 1 (continued) Affinities of the 5-HT 2 receptor agonist and antagonist compounds 
to different neurotransmitter receptors. Most values are pK,, other values are marked 
with alphabetic upper indexes (■: pEC 50 , b :pIC 50 ,': pID S0 , d: pK„). References are indicated 
with numeric upper indexes and the codes are given below the table. not determined. 


Compound 

Function 

5-HT 2A 

5-HT 2B 

5-HT 2C 

Other receptors 

LY 53857® 

Antagonist 

7.3 

8.2 

8.1 


LY-23728® 

Antagonist 

7.18 

- 

6.90 


LY-266097® 

Antagonist 

7.71 

9.30 

7.61 


LY-287375® 

Antagonist 

8.06 

- 

8.11 


Ml 00907® 

Antagonist 

9.10 

6.10 

6.95 


mCPF 1 ' *> 

Agonist 

6.7* 1 ' 

7.4-m 

7.8® 

5-HT 1A : 5.9* ®; 

5-HT 1B : 6.5* « 

Mianserin® *> 

Antagonist 

8.1<') 

7.3<>> 

8.0® 

5-HT,® 

Mirtazapine® 

Antagonist 

- 

- 

8.75' 

5-HT 3 : 8.1; 

HI: 9.3; a2: 6.95 

Olanzapine 0 ' 8) 

Antagonist 

8.60® 


8.15® 

5-HT 1A : 5.55 (8) ; 

5-HT 6 : 8.60®; 

D,: 7.16 (7) ; D 2 : 7.96i 8 >;Ml: 
7.16m; M2: 6.21™; M3: 

6.90' 7 '; M4: 6.46< 7 >; M5: 

7.09m; a l: 7.72 (8) ; HI: 9.19 (3) 


ORG 35035m 

Agonist 

7.0 


8.5 

5-HT 1D : 7.4; 

5-HT 6 : 6.2 

Pipamperone (3> 

Antagonist 

8.27 


6.92 

a2B: 7.46; D 42 : 8.29 

PNU-22394® 

Agonist 

7.72 

7.55 

7.70 


Risperidone® 

Antagonist 

9.28 


7.32 

D 2 : 8.23; 5-HT,: 8.80; 
alA: 8.64 

Ritanserin® 

Antagonist 

8.8 

8.3 

8.9 


RO 60-0175 / ORG 

35030® 

Agonist 

6.0 

5.8 

8.8 


RS-102221® 

Antagonist 

6.0 

6.1 

8.4 


RS127445 / 

MT500® 

Antagonist 

6.30 

9.50 

6.40 



Code for references: 1: [40]; 2: [1]; 3: [70]; 4: [71]; 5: [72]; 6: [73]; 7: [74]; 8: [75]; 9: [44]; 
10: [30]; 11: [76]; 12: [77], 
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Table 1 (continued) Affinities of the 5-HT 2 receptor agonist and antagonist compounds 
to different neurotransmitter receptors. Most values are pK,, other values are marked 
with alphabetic upper indexes (■: pEC 50 , b :pIC 50 , c : pID S0 , d: pK„). References are indicated 
with numeric upper indexes and the codes are given below the table. not determined. 


Compound 

Function 

5-HT 2A 5-HT 2B 

5-HT 2C 

Other receptors 

RS62203 / fanan- 

Antagonist 

9.60 - 

7.60 


S-35526W 

Antagonist 

8.39 

6.34 


Sarpogrelate® 

Antagonist 

8.07 - 

- 


SB 200646A' 1 - 6 * 

Antagonist 

5.2°) 7.5“> 

6.9“) 

5-HT 1A : 5.2 

SB 204741“.« 

Antagonist 

< 5.2“) 7.1“) 

5.8“> 

5-HT 1A m ; 5-HT 1d “>; 

5-HT 1e |6) ; 5-HT 3 “>; 

5-HT 4 <*> 

SB 206553“°> 

Antagonist 

5.8 8.3 

8.5 


SB 215505“»> 

Antagonist 

6.80 8.30 

7.70 


SB 242084“> 

Antagonist 

6.8 7.0 

9.0 


SB 243213 (U) 

Antagonist 

7.01 7.20 

9.37 

5-HT 1D : 6.32; 

5-HT 4 : 6.17; 

5-HT 6 : 6.50; 

D 2 : 6.68; D 3 : 6.50; 

D 4 : <6.4 

Seroquel' 3 ' 

Antagonist 

7.02 

5.42 

alA: 7.26; HI: 8.66 

Sertindole 131 

Antagonist 

9.41 

8.72 

alA: 8.75 

Spiperon' 1 - 61 

Antagonist 

8.8“) 5.5“> 

5.9“> 

D,: ~6.46“>; 

D 2 : 10.22W; D 3 : 9.221®; D 4 : 
10.10“); 

D 5 : -5.46 “> 

SR46349B / epl- 
ivanserin™ 

Antagonist 

8.20 - 

6.90 


WAY-161503< 2 > 

Agonist 

8.40 8.04 

9.00 


Y-39241“> 

Antagonist 

10.05 - 

- 


Ziprasidone 18 ' 121 

Antagonist 

9.38“) 7.57“ 2 > 

7.1702) 

5-HT 1A : 8.47“); 

D 2 : 8.32“>; al:7.96“> 

5-HT 1D “>; Hl“>; Ml“> 


Code for references: 1: [40]; 2: [1]; 3: [70]; 4: [71]; 5: [72]; 6: [73]; 7: [74]; 8: [75]; 9: [44]; 
10: [30]; 11: [76]; 12: [77], 
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Factors influencing the effects of 5-HT 2 receptor ligands on vigilance: 
special emphasis on the actual vigilance state 

Although there are several studies about the effects of activation or blockade 
of serotonin 2 receptor subtypes on sleep and EEG, the results are not consis¬ 
tent. Several reasons must be considered: 

- The functions mediated by different 5-HT 2 receptor subtypes are different, 
and most drugs with high affinity to 5-HT 2 receptors are not subtype selec¬ 
tive (see Tabs 1 and 2). 

- Receptors of one subtype are located at more than one brain region involved 
in the regulation of vigilance, and thus exert different, sometimes opposite, 
functions (see 5-HT 2 receptor signaling above). 

- Depending on their chemical structure, drugs acting on the same receptor 
subtype can affect different cascades even in the same cell [3], 

- The effects of agonists and especially antagonists depend on the actual vigi¬ 
lance state of the animal, since the activation 5-HT 2 receptors is different in 
each vigilance state due to the markedly different endogenous serotonergic 
tone. Thus, the effect of a drug depends on the time of administration re¬ 
garding the 24-h cycle and the actual vigilance state studied (see Fig. 1) [32], 

The serotonergic system is a part of the ascending reticular arousal system, 
and its activity shows marked changes during the 24-h cycle. Extracellular lev¬ 
els of 5-HT are found to be the highest in waking and the lowest in rapid eye 
movement (REM) sleep in the brainstem and cortex of rats [33] and the DRN 
[34] and medial pontine reticular formation [35] of cats. According to these 
data, the firing rates of both serotonergic neurons of DRN and noradrener¬ 
gic cells of LC (both neuron populations are also known as REM-off cells) 
are markedly different depending on vigilance stages. The highest firing rate 
can be observed in waking, medium level is present during NREM, while they 
become virtually quiescent during REM sleep [36, 37], Since intracellular sero¬ 
tonin level is highest in waking, serotonin receptor antagonists exert their ef¬ 
fects most intensively during this period. The relative time spent in REM sleep 
grows continuously from the beginning of the passive phase, suggesting that in 
this period the serotonergic tone is the lowest during the 24-h cycle. Thus, the 
effect of a serotonin receptor antagonist is lowest around the middle or before 
the end of the passive phase. 

In most studies the effects of an agonist during the active period was not 
compared to its effects during the passive phase. A separate analysis of the 
effect for each vigilance stage after a single injection of the 5-HT 2 receptor an¬ 
tagonist ritanserin with a very long half-life (more than 24 h) also provides evi¬ 
dence for the fundamental role of the endogenous serotonin level. Ritanserin 
is a non-subtype-selective 5-HT 2 receptor antagonist, therefore the influence on 
different vigilance stages and at different time of the day can be studied after a 
single-dose administration of this compound (see Fig. 1) [32], 
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Fig. 1 Effect of ritanserin, a non-subtype-selective 5-HT 2 receptor antagonist adminis¬ 
tered i.p. at light onset at a dose of 0.3 mg/kg on vigilance states, motor activity and 
delta power [32], The drug was administered and recording was started at light onset. 
Data of hours 1-2 (beginning of the passive phase), 9'-10 (late passive phase) and 13-14 
(beginning of the active phase) are shown. Light gray column: vehicle; dark gray co¬ 
lumn: ritanserin. 

* Significant effect of ritanserin compared to vehicle. # Significant difference compared to 
the first 2 h. 
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Fig. 1 (continued) Effect of ritanserin, a non-subtype-selective 5-HT 2 receptor anta¬ 
gonist administered i.p. at light onset at a dose of 0.3 mg/kg on vigilance states, motor 
activity and delta power [32], The drug was administered and recording was started at 
light onset. Data of hours 1-2 (beginning of the passive phase), 9'-10 (late passive phase) 
and 13-14 (beginning of the active phase) are shown. Light gray column: vehicle; dark 
gray column: ritanserin. 

* Significant effect of ritanserin compared to vehicle. # Significant difference compared to 
the first 2 h. 


The drug was administered at the beginning of the passive phase. In the 
first 2 h after the injection, there were significant changes caused by ritanserin 
in time spent in several sleep stages and in EEG power spectra. At 9-10 h (i.e., 
2-3 h before the end of the passive phase, when endogenous serotonin level is 
very low) no changes were detectable in any of the vigilance states studied, nor 
in the EEG power spectra. At the beginning of the active phase, when endo¬ 
genous serotonin level rises sharply, blockade of 5-HT 2 receptors by ritanserin 
resulted in changes in the time spent in different vigilance states and in motor 
activity (although effects on vigilance states were different from those obtained 
in the first 2 h) (see Fig. 1) [32], 
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The frequency band of EEG power spectrum affected by this compound 
also depends on the actual vigilance state. Ritanserin increases delta activity 
in the first 2 h of the passive phase, when serotonergic system shows a moder¬ 
ate activity. The proportion of deep SWS (SWS-2) and the mean delta activ¬ 
ity are highest during this period of the day, and ritanserin caused a further 
shift towards the rate of low frequencies. Delta activity is a consequence of 
thalamocortical oscillation not disturbed by incoming stimuli, and uncharac¬ 
teristic for wakefulness, therefore the blockade of 5-HT 2 receptors was not able 
to influence the power of this frequency in the active phase (see Fig. 1) [32], In 
another experiment, a 5-HT 2C antagonist SB-242084 increased theta activity 
only during wakefulness [29], Elevated theta activity is typical for wakefulness 
and REM sleep, but the serotonergic system is almost silent during REM sleep, 
so the antagonist is not be able to affect theta activity significantly at this sleep 
stage. 



TIME 



Fig. 2 Effect of SB-242084, a 5-HT 2C receptor antagonist administered i.p. at light onset 
at a dose of 0.3 mg/kg on vigilance states [29], The figure represents the cumulative time 
of each vigilance state in the first 4 h after the injection. 

* Significant effect compared to vehicle. 

























398 


Tamas Kitka and Gyorgy Bagdy 






n 

* 

* 

Sj 

i 

Pft 


1 

m 


M 


w 


TIME 


Fig. 2 (continued) Effect of SB-242084, a 5-HT 2C receptor antagonist administered i.p. 
at light onset at a dose of 0.3 mg/kg on vigilance states [29], The figure represents the 
cumulative time of each vigilance state in the first 4 h after the injection. 

* Significant effect compared to vehicle. 
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Rodent studies 
Local microinjections 

Agonists and antagonists of 5-HT 2 receptors were applied to the LDT and 
DRN of rats. The non-subtype-selective 5-HT 2 receptor agonist l-(2,5-dime- 
thoxy-4-iodophenyl)-2-aminopropane (DOI) decreased the time spent in REM 
sleep and the number of REM episodes after being injected into either LDT 
or DRN [38, 39], although these effects of the drug were detected at different 
times after the injection. After an injection of DOI to the LDT, a significant 
decrease of the cumulative time of REM sleep was seen after 1 h and a signifi¬ 
cant reduction of the number of REM episodes was found after 2 h [39], DOI 
did not have an effect on the duration of REM episodes when injected into the 
LDT; the reduction of time spent in REM was caused by the reduction of the 
number and so the cumulative time of the sequential REM episodes, i.e., the 
episodes separated by an interval less or equal to 3 min [39], so it seems that 
DOI inhibits the “switch-back” to REM sleep. After injection into the DRN, 
DOI reduced both cumulative REM time and number of REM episodes dur¬ 
ing the first 2 h as well as in the next 2 h, with both effects being stronger during 
the second 2-h interval. A lower dose only reduced the cumulative REM time 
[38], All effects of the drug in these two experiments were dose dependent. 

Injecting ketanserin, a 5-HT 2 receptor antagonist with some 5-HT 2A subtype 
selectivity [40] into the LDT of rats resulted in an increase in the cumulative 
time of REM sleep as well as in the number of sleep episodes [39], but the du¬ 
ration of REM episodes remained unchanged. EMD 281014 and SB 243213, 
which are 5-HT 2A and 5-HT 2C receptor antagonists, respectively, did not alter 
the REM sleep when injected into the DRN, but both of them increased light 
slow wave sleep (SWS-1) [38], 


Systemic administration 

The vast majority of studies in this field used systemic administration of 5-HT 2 
receptor agonist and antagonist compounds. These are summarized in Table 2, 
in which the compounds are grouped based on their agonist or antagonist 
properties and their affinities to the different 5-HT 2 receptor subtypes. 


Effects of subtype-selective 5-HT lx receptor agonists and antagonists 

The 5-HT 2A receptor antagonist MDL 100907 was found to decrease wakeful¬ 
ness and REM as well as increase NREM in mice [30] at a dose of 2 mg/kg. 
These effects were noticeable at the first 3 h post injection (the treatment was 
performed 3 h after lights on). In rats, the 5-HT 2A receptor antagonists ICI 
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◄ Fig. 3 Effect of SB-215505, a 5-HT 2B receptor antagonist administered intraperitone- 
ally at light onset at a dose of 1.0 mg/kg on vigilance states during the first hour after 
administration [16]. 

* Significant effect compared to vehicle. 


169369 and ICI 170809 were shown to reduce cumulative time and number of 
REM episodes and increase REM latency [41], ICI 170809 also increased the 
length of REM episodes and time spent in NREM, but the latter was only no¬ 
ticeable at a dose of 20 mg/kg [41, 42], 

EMD 281014 decreased REM in the first and second 2-h periods after treat¬ 
ment (the animals received the injection approximately 2-3 h after lights on); 
the number of REM episodes was also reduced during this period, further¬ 
more, the REM latency was found to lengthen [43], 


Effects of subtype-selective 5-HT 2B receptor agonists and antagonists 

The 5-HT 2B receptor agonist BW 723C86 caused a decrease in the time spent 
awake and in REM sleep and increased NREM in mice [30], These effects were 
significant during the first hour post injection at a dose of 10 mg/kg, when the 
compound was administered 3 h after the beginning of the passive phase. 

The 5-HT 2B receptor antagonist SB 215505 increased wakefulness in mice 
and rats (Fig. 3) [16, 30], In rats, increased motor activity was also registered 
[16]. NREM is also affected by 5-HT 2B receptors, as SB 215505 decreased 
NREM in mice [30] and reduced deep slow wave sleep (SWS-2) in rats [16], 
REM sleep of mice and rats were also depressed by this drug. The effects were 
significant at a dose of 1 mg/kg (except from the decrease in NREM sleep of 
mice that was also noticeable at a dose of 0.5 mg/kg) at 1 h post injection, with 
the injection being administered at the beginning of the passive phase and 3 h 
after lights on to the rats and mice, respectively [16, 30], 


Effects of subtype-selective 5-HT lc receptor agonists and antagonists 

5-HT 2C receptor agonists (Ro 60-0175/ORG 35030 and Ro 60-0332/ORG 35035) 
were found to decrease motor activity and increase passive wake. REM sleep 
was reduced after i.p. administration of Ro 60-0332 and after per os adminis¬ 
tration of Ro 60-0175 and Ro 60-0332 [44], The animals received these drugs at 
the beginning of the passive phase and these changes were observed up to the 
first 3 h after the treatment. 
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The 5-HT 2C receptor antagonist SB 242084 did not alter wakefulness and 
NREM sleep in mice at a 2.5 mg/kg dose, but a decrease in REM sleep was 
observed during the first 3 h even after an a dose of 1 mg/kg. In this study, the 
drug was injected i.p. 3 h after lights on [30], This antagonist administered in 
rats at the onset of the passive phase increased wake and decreased SWS-2 and 
REM in the first hour post injection at a dose of 1 mg/kg (Fig. 2), but not at 
lower doses. In contrast, the drug’s theta-enhancing effect during wakefulness 
was significant even at a dose of 0.1 mg/kg [29], SB 242084 also caused an in¬ 
crease in SWS-1 in the same experiment, but this effect occurred later, at 3-4 h 
post injection, when the effects on wake and SWS-2 was already diminished 
[29], Interestingly, after oral administration at the beginning of the light phase, 
SB 243213, another 5-HT 2C receptor antagonist, at a dose of 10 mg/kg, in¬ 
creased the total time of SWS-2 over the period 2-6 h after dosing by reducing 
the number but lengthening the duration of SWS-2 stages [45], The cumulative 
time and the number of REM episodes were also decreased by this drug over 
the 2-12-h period after administration, but also these effects were noticeable 
only at a dose of 10 mg/kg, lower doses were inefficient [45], In another experi¬ 
ment, after administrating SB 243213 2-3 h after the onset of passive phase, no 
changes in the sleep pattern were observed for 4 h , but at 5-6 h after injection 
(approximately 7-9 h of the passive phase) a decrease in the cumulative time of 
REM and a reduction of the number of REM episodes were noticed [43], 


Effects of non-subtype-selective 5-HT 2 receptor agonists and antagonists 

The non-subtype-selective 5-HT 2 receptor agonist DOI increased wake [43,46], 
decreased SWS-2 in rats in the first 2 h post injection, and increased SWS-1 
and decreased REM in the first and second 2-h post-injection periods in studies 
in which the drug was administered approximately 2-3 h after lights on [43], 
REM and sleep latency increased and the number of REM periods decreased 
after DOI treatment [43], All effects of this drug (except the increase of sleep la¬ 
tency) were noticeable at a dose of 0.35 mg/kg. Another non-subtype-selective 
5-HT 2 receptor agonist, l-(m-chlorophenyl)piperazine (mCPP), was shown to 
decrease slow wave sleep (SWS) and increase REM latency and wake [47], This 
effect is also present after administration of subtype-selective 5-HT 2C agonists. 

Ritanserin, a non-subtype-selective 5-HT 2 receptor antagonist was found to 
increase SWS-2 in several studies [32, 48-50], Decreased wake was also regis¬ 
tered [32, 49, 51], and within wake, active wake was reduced and passive wake 
was elevated [51]. SWS-1 was found reduced at the beginning of the passive 
phase and increased at the beginning of the active phase when the drug was ad¬ 
ministered at light onset (Fig. 1) [32], but other studies reported elevated SWS- 
1 after ritanserin treatment [49, 51]. Kirov and Moyanova [49] found the most 
robust increase in the SWS-2 with a minor increase in SWS-1. Since, in general, 
ritanserin shifts vigilance state in an active wake —> passive wake —► SWS-1 
—> SWS-2 way, comparisons can only be taken to control animals considering 
also the previous vigilance state. The difference between the two results may 
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also be caused by differences in sleep staging: separate analysis of intermediate 
stage (IS) of sleep showed that this stage was much more affected than REM 
sleep by ritanserin [32], In most studies, however, IS was included in REM or 
NREM, causing some confusion in the interpretation of the effects of ritanse¬ 
rin on REM. The timing and method of drug administration, anxiety dose, and 
other factors can also modulate the effect of a drug. Decreased REM [49-51] 
with decreased REM frequency and increased duration of each episode [51] 
was also found by some authors. Ritanserin has been shown to lengthen sleep 
episodes [48] and reduce motor activity at certain periods of the day [32], Since 
ritanserin has a very long half-life, its effects last for various vigilance states, 
and as the endogenous serotonin level fluctuates over the day, the effects of this 
antagonist change as well. The daily rhythm of endogenous serotonin level and 
other endogenous and exogenous factors can strongly modulate the effect of 
serotonin receptor agonists and especially antagonists. These effects are sum¬ 
marized under Factors influencing the effects of 5-HT 1 receptor ligands on vigi¬ 
lance: special emphasis on the actual vigilance state above. 

When ritanserin was administered at light onset at a dose of 0.3 mg/kg, 
SWS-2 and total sleep time were elevated, SWS-1 and the IS of sleep were re¬ 
duced during the first 2 h (Fig. 1) [32], After 9-10 h (2-3 h before the end of the 
passive phase) no effects of ritanserin were noticeable compared to vehicle. At 
13-14 h (at the beginning of the active phase, when endogenous serotonin level 
rises) elevated total sleep time and SWS-1 were recorded, in accordance with 
the finding that the motor activity in that period was reduced by the drug, so we 
can conclude that ritanserin inhibited the awakening effect of the physiological 
increase of serotonin level at the beginning of the active phase [32], 

A 5-HT 2A/2C receptor antagonist RP 62203 increased SWS-2 at the expense 
of wakefulness in rats [46], Serotonin 2A/2C receptor antagonists RP 62203, 
deramciclane and sertindole increased SWS-2 [46, 48, 52], Sertindole-induced 
increase in SWS-2 was measured at the dark phase, over 4 h, starting just af¬ 
ter the injection. This drug also caused a decrease in REM sleep, and this ef¬ 
fect was significant even during the second experimental day over a 4-h period, 
starting 22 h after the treatment [52], A lengthening of sleep episodes was ob¬ 
served after per os administration of deramciclane [48], 

In mice, 5-HT 2B/2C receptor antagonist SB 206553 increased wakefulness and 
reduced NREM and REM sleep at a dose of 2.5 mg/kg [30], This effect was no¬ 
ticeable only during the first hour after the treatment, and the animals received 
the injection 3 h after lights on. 


Summary of the role of different 5-HT 2 receptor subtypes in sleep 
and waking 

The effect of 5-HT 2 receptors on each vigilance state can be summarized as 
follows: 

- Considering the effects of more or less subtype-selective drugs administered 
systemically on wakefulness, we can presume that activation of 5-HT 2A re- 
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ceptors results in an increase, and activation of 5-HT 2B receptors cause a de¬ 
crease in waking (Tab. 3). Subtype-selective 5-HT 2C receptor agonists cause 
an increase in waking, while the 5-HT 2C receptor antagonists have little ef¬ 
fect. The effect of non-subtype-selective drugs depends on their relative af¬ 
finities. Usually, the 5-HT 2A receptor effects dominate the outcome on sleep- 
wake stages with some modulatory effect of 5-HT 2B and 5-HT 2C receptors. 
In the case of selective 5-HT 2B/2C receptor antagonists, the effect of 5-HT 2B 
receptor dominates in general (Tab. 3). 

- Activation of serotonin 2A and 2B receptors may decrease and increase, re¬ 
spectively, NREM sleep (Tab. 4). 

- Compounds with high affinity to 5-HT 2 receptors reduce REM sleep in gene¬ 
ral. This effect is usually the result of the thinning out of REM episodes. 


EEG power spectra 

MDL 100907, a 5-HT 2A receptor antagonist was found to increase EEG power 
at 2-3 Hz in the prefrontal cortex of conscious rats at 0.01 and 0.05 mg/kg s.c. 
doses (at a dose of 0.1 mg/kg, the EEG power was elevated at 7-10-Hz and 
at 14-18-Hz bands) [53] or hippocampal EEG power of anesthetized rats at 
3-5 Hz at a dose of 1.0 mg/kg i.v. [28], 

A 5-HT 2B receptor antagonist (SB 215505) decreased frontal cortical EEG 
power at the 3-8-Hz band during wakefulness [16]. This dose-dependent effect 
was maximal at 6-7 Hz and was noticeable even at a dose of 0.1 mg/kg. During 
NREM sleep, a reduction of EEG power in the 2-5-Hz band was recorded, 
and, during REM sleep, the decrease in EEG power was observed at 7 Hz after 
treatment with a dose of 0.1 mg/kg. The highest dose (1 mg/kg) exerted stronger 
reduction and broadened the affected band to 6-9 Hz during REM sleep [16]. 

Serotonin 2C receptor agonist Ro 60-0175 and mCPP, a non-subtype-spe- 
cific 5-HT 2 receptor agonist with some 5-HT 2C receptor preference caused a 
desynchronization and reduced hippocampal EEG power in anesthetized rats, 
especially in the theta frequency (Hajos et al. [28] take the theta frequency 
to 3-5 Hz) and these effects were reversed by the 5-HT 2C receptor antagonist 
SB 242084 [28], This latter drug administered alone caused an increase in the 
3-5-Hz band in the same experiment. In conscious freely moving rats, fron¬ 
tal cortical theta oscillation was enhanced by i.p. SB 242084 treatment during 
wakefulness [29], A significant increase was recorded at 8 Hz after administrat¬ 
ing that drug with a dose of 0.1 mg/kg, and, after a dose of 1.0 mg/kg, an aug¬ 
mented EEG power at 5 Hz was also observed. Theta activity during REM was 
not enhanced, supporting the conclusion that the low serotonergic tone is not 
enough to show the antagonist effect on 5-HT 2C receptors at this stage [29], 

It seems that activation of 5-HT 2B and 5-HT 2C receptors by agonists and/ 
or by endogenous 5-HT tone increases and decreases, respectively, theta activ¬ 
ity, while 5-HT 2A receptors do not play a crucial role in regulating the theta 
activity. 
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Non-subtype-selective 5-HT 2 receptor antagonists (deramciclane, a HT 2A(2C 
receptor antagonist, and ritanserin, a 5-HT 2 receptor antagonist) were shown 
to increase the incidence and length of high-voltage spindle episodes [48], Ri¬ 
tanserin (0.3 mg/kg, i.p.) caused an increase in the low frequency range (0.25- 
6 Hz, mainly delta activity) (see Fig. 1), and a decrease in the high frequency 
range (27-30 Hz) at the light (passive) phase, immediately after the administra¬ 
tion (treatment was performed at light onset) [32], Close to the end of passive 
phase (9-10 h after the treatment), ritanserin had no significant effect compared 
to vehicle, in accordance with the absence of effects on the vigilance in those 
hours. At dark onset, when endogenous serotonin level rose, ritanserin dimin¬ 
ished the physiological decrease of spindle frequency activity and caused a rela¬ 
tive increase in a wide band of 2-19 Hz (peak was situated at 12-15 Hz) [32], 


Human studies 

Several changes in sleep parameters have been described after blockade of 
5-HT receptors. Agonists are not frequently used in human experiments, but the 
5-HT 2C receptor agonist mCPP, which is not really subtype selective, has been 
shown to reduce sleep efficiency, total sleep time, SWS and REM, and prolong 
stage 1 of NREM sleep [54, 55], In general, non-subtype-selective 5-HT 2 recep¬ 
tor antagonists are used in human experiments; therefore, the effects and roles 
of each 5-HT 2 receptor subtype are not clearly defined in humans. The most 
general effect of 5-HT 2 receptor antagonists on human sleep is an increase in 
SWS (NREM stages 3+4). It was registered after administration of ritanserin, 
ICI169369 (non-subtype-selective 5-HT 2 receptor antagonists), mirtazapine, se- 
ganserin (nonspecific, high-affinity antagonists acting on 5-HT 2A and/or 5-HT 2C 
receptors), ketanserin (non-subtype-selective 5-HT 2 receptor antagonist with a 
5-HT 2A receptor preference) and SR 46349B (5-HT 2A receptor antagonist) [27, 
56-64], Since ritanserin had stronger SWS-enhancing effect than ketanserin, 
and ritanserin has a higher affinity to HT 2C receptors than ketanserin, it was 
hypothesized that the increase of SWS is caused by the blockade of 5-HT 2C 
receptors [27], Extensive subsequent studies mainly in rodents, however, failed 
to confirm this hypothesis; they support the dominant role of 5-HT 2A receptors 
in this effect. The only subtype-selective antagonist used in humans was SR 
46349B, a 5-HT 2A receptor antagonist. This drug, in addition to the increase 
in SWS, caused a decrease in the stage 2 of NREM sleep. This effect was not 
noticeable after administrating other compounds with 5-HT 2 receptor affinity 
[56], Stage 1 of NREM sleep was found to decrease after mirtazapine treat¬ 
ment [59], Daytime sleepiness decreased, and subjective sleep quality increased, 
after ritanserin treatment [57, 58, 62], Mirtazapine, ritanserin and seganserin 
reduced the number of awakenings at night [59, 61, 62], 

The most common effect of these drugs on quantitative EEG is an enhanced 
delta (0.75—4.5 Hz) power during sleep, and that is compatible with their SWS- 
increasing profile. This effect was noticeable after ritanserin, seganserin and 
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SR 46349B treatment as well [56, 58, 60, 61]. Seganserin enhanced theta power 
(5-9 Hz) [61], while ritanserin and SR 46349B decreased sigma activity (12.25- 
15 Hz) [56, 58]. Human studies with atypical antipsychotic compounds with 
high 5-HT 2 receptor affinity are summarized below. 


Effect of antipsychotic drugs with high affinity to 5-HT 2 
receptors on vigilance 


Several antipsychotic drugs that exert antagonist effect on different mono¬ 
amine receptors, including, e.g., dopamine and adrenergic receptors, also have 
very high affinity to 5-HT 2 receptors. In rats, the non-selective 5-HT 2 receptor 
antagonist clozapine caused an increase in waking and a decrease in pre-REM 
(IS) and REM sleep in the first hour after administration, while decreased wak¬ 
ing and REM and increased NREM were recorded in the second hour. Slow 
wave EEG activity was found decreased in the first 2 h. On the day of the acute 
treatment, increased REM latency, a decrease in the number of NREM and 
REM episodes, and an increase in mean NREM episode duration were reg¬ 
istered [65], Risperidone is another atypical antipsychotic agent with a 5-HT 2 
receptor agonist property. Low doses (0.01-0.16 mg/kg) of this compound 
caused a significant increase of SWS-2 and a significant decrease of SWS-1 
and wakefulness in the first 4 h after administration in rats. These results are 
consistent with the very high affinity of this compound to 5-HT 2A receptors. In 
contrast, high doses (0.63-2.5 mg/kg) produced an opposite effect. Paradoxical 
sleep was significantly reduced during the first 4 h after administration over 
the dose range tested in the same study [66], In another study, risperidone was 
found to synchronize EEG power spectrum with a peak of 7 Hz in rats at a 
dose of 0.5 mg/kg [67], 

In humans, both ziprasidone (a compound having antagonist properties with 
high affinity to 5-HT 2 receptors) and olanzapine (a 5-HT 2C receptor antagonist) 
caused a decrease in REM and an increase in REM latency [68, 69], Olan¬ 
zapine increased SWS and decreased daytime sleepiness, as well as subjective 
sleep quality, and sleep continuity was improved [69], These effects are similar 
to those described after the administration of the 5-HT 2 receptor antagonist 
ritanserin. 
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Abstract 

The 5-HT 3 receptor is a ligand-gated ion channel that belongs to the Cys-loop family, 
which also includes receptors such as the nicotinic acetylcholine receptor. As other 5-HT 
receptors subtypes, the 5-HT 3 receptor seems to be involved in a large range of physi¬ 
ological processes, among of them sleep. Its role in the sleep-wake physiology has not 
been clearly established until now, but several pieces of evidence show its activation effect 
on wakefulness and inhibitory effect on slow-wave sleep. In addition, the 5-HT 3 recep¬ 
tors seem to be implicated in circadian rhythm regulation and in REM sleep propensity. 
Many studies highlight its role in sleep disorders and more precisely in obstructive sleep 
apnea (OSA) and in fibromyalgia. Its effects in OSA are double. Indeed, 5-HT 3 receptor 
antagonists increase respiration both at the central and the peripheral levels, and thus are 
potential therapeutic drugs for OSA. Drugs acting on 5-HT transmission have brought 
interesting results in animal models of apnea syndrome, as well as in patients with OSA. 
However, results are still disappointing since, in contrast to nasal continuous positive air¬ 
way pressure that suppress nearly all respiratory events, drugs only lower the respiratory 
disturbance index by about 20-50%. Chronic pain that relates to inflammatory processes 
implicates 5-HT 3 neurotransmission, and there is some evidence that the 5-HT 3 receptor 
antagonist tropisetron had beneficial effects on pain intensity and sleep disturbance in pa¬ 
tients with fibromyalgia. 


Introduction 

The serotonin (5-hydroxytryptamine, 5-HT) neurons in the brainstem raphe 
nuclei form the largest and most complex efferent system in the brain. As a 
consequence, 5-HT is involved in many physiological and behavioral systems, 
and this is reflected by the use of numerous 5-HT-related drugs applied as treat- 
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ments across a wide variety of very different clinical conditions. Indeed, 5-HT 
mediates cardiovascular and respiratory activity, sleep, nutrient intake, sexual 
activity, anxiety, mood, aggression and nociception. 5-HT produces its effects 
through a variety of membrane-bound receptors. Among them, the 5-HT 3 re¬ 
ceptor takes up a particular place since it is the only ligand-gated ion channel 
and it mediates fast 5-HT synaptic transmission. Indeed, the 5-HT 3 receptor 
belongs to the Cys-loop family of ligand-gated ion channel, which include nic¬ 
otinic acetylcholine receptors (n-AchR), GABA a receptors and glycine recep¬ 
tors. 

The physiological role of 5-HT 3 receptors remains elusive. In contrast to the 
huge interest in the pharmacology of 5-HT 3 receptor antagonists (such as on¬ 
dansetron, tropisetron and granisetron) that are considered as a tremendous 
step forward in the prevention of chemotherapy- and radiotherapy-induced 
nausea and vomiting, progress in understanding central 5-HT 3 receptor physio¬ 
logy has lagged behind. Over the last few years, a renewed interest in 5-HT 3 
receptors has emerged since 5-HT 3 antagonists have been found to be clini¬ 
cally relevant in different pain syndromes such as chronic neuropathic pain, mi¬ 
graine, rheumatoid arthritis, tendinopathies, fibromyalgia and irritable bowel 
syndrome [1], but also in psychiatric disorders such as anxiety, depression and 
schizophrenia [2, 3], Other new perspectives in clinical use of 5-HT 3 ligands are 
drug addiction, cognitive functions, and satiety control [1]. 

Although 5-HT has been implicated in the regulation of sleep for more than 
40 years [4-8], the specific role of 5-HT 3 in sleep physiology has been addressed 
by very few studies. Adrien et al. [9] and Ponzoni et al. [10, 11] reported di¬ 
vergent effects of 5-HT 3 ligands on rat REM and slow-wave sleep (SWS) that 
could be accounted by dosage ranges and by route or site of administration. In 
humans, two studies in healthy subjects suggested a role of 5-HT 3 receptors in 
REM sleep regulation [12, 13], During the last decade, interest in 5-HT 3 recep¬ 
tors ligands as potential treatment in the field of sleep medicine has grown, 
with results of animal and human studies suggesting that drugs antagonizing 
5-HT 3 receptors could be effective in the treatment of sleep apnea [14] and of 
fibromyalgia syndrome [1], 

The present review focuses on investigations on the pharmacology of the 
5-HT 3 receptor, including structural, functional and anatomical aspects that 
relate to sleep-wake physiology and sleep medicine. 


General description of the 5-HT 3 receptor 

5-HT 3 receptors are pentamers [15] and members of the superfamily of ligand¬ 
gated ion channels [16], Each subunit is composed of four transmembrane do¬ 
mains, the second of which delineates the ion channel pore [17] (Fig. 1). The 
extracellular N-terminal domain contains the agonist recognition site [18-20], 
There are two 5-HT 3 subtypes : the 5-HT 3A and the 5-HT 3B subtypes. The 
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5-HT 3A subtype is present in two splice variants: a long and a short variant. In 
the short one, five or six amino acid residues of the intracellular loop between 
the third and fourth transmembrane domains are deleted [17]. This form is the 
most abundant in the brain and, in human, the only present in the CNS [21], 
These two 5-HT 3A variants appear, however, to possess similar distributions, 
pharmacological profiles and electrophysiology characteristics [22], The het- 
eromeric combination of 5-HT 3A and 5-HT 3B subunits seems to be necessary to 
provide the full functional features of the 5-HT 3 receptor [23-25], It has been 
suggested that subunits belonging to other receptors than the 5-HT 3 could par¬ 
ticipate in its assembly. This idea originates in the finding that the a4 subunit 
of the n-AchR can co-assemble with the 5-HT 3A subunit to form a functional 
5-HT 3 receptor [26, 27], Whether such heteromeric receptors are present in the 
CNS remains to be determined. A wide range of compounds such as alcohol, 
certain anesthetic agents and divalent cations modulate the 5-HT 3 receptor. 
Multiple modulatory sites are present on the receptor complex [28], 

The 5-HT 3 receptor is a nonselective cation channel (Na + , Ca 2+ , and K + ) that 
has electrophysiological properties similar to those of the nicotinic acetylcho¬ 
line or GABA a channels [29], Its activation leads to a transient inward current, 
and thus induces a rapid depolarization of the neuron. The major consequence 
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of this depolarization is an increase of intracellular Ca 2+ concentration and 
subsequent neurotransmitter release. The response desensitizes and resensitizes 
rapidly [30], Co-expression of 5-HT 3A with 5-HT 3B or a4 n-AchR subunits re¬ 
sults in a larger single-channel conductance, response amplitude and Ca 2+ per¬ 
meability in comparison to homomeric 5-HT 3 receptors. 

5-HT 3 receptors are found on neurons of both central [31, 32] and periphe¬ 
ral origin [33], In the periphery, they are located on pre- and postganglionic 
autonomic neurons and neurons of the sensory nervous system [34, 35], In the 
brain, the highest densities are found in the area postrema, the nucleus of the 
solitary tract and nuclei of the brainstem such as in the dorsal vagal complex 
[36], Moderate density of this receptor is found in the olfactory bulb, the sub¬ 
stantia gelatinosa of the spinal cord [37], the trigeminal nucleus and the amyg¬ 
dala. It is also found in other higher brain areas such as frontal and entorhinal 
cortex, hippocampus, nucleus accumbens, dorsal nucleus raphe, striatum, sub¬ 
stantia nigra and medial habenula, but at lower densities [38-41], 

This receptor can be postsynaptic, notably on neurons in the forebrain, 
the amygdala, the hippocampus, the olfactory bulb and in the visual cortex 
[42-44], It has been notably demonstrated to be colocalized with GABAergic 
neurons in the neocortex, the olfactory regions, hippocampal formation, amyg¬ 
daloid complex and septal region [45], 5-HT 3 receptors have also been localized 
on presynaptic nerve terminals, where they modulate neurotransmitter release 
[46-49], First indirect evidence for presynaptic localization of the 5-HT 3 recep¬ 
tor was provided by comparison between studies using autoradiography [39] 
and in situ hybridization [50], Some brain structures, including for example hip¬ 
pocampus or area postrema, that show 5-HT 3 receptor binding sites using au¬ 
toradiography have not revealed hybridizing cells, suggesting a presynaptic lo¬ 
calization of this receptor. Presynaptic 5-HT 3 receptors have been subsequently 
directly demonstrated by immunohistochemistry in subsets of synaptosomes 
from hippocampus, striatum, amygdala and cerebellum [51, 52], This localiza¬ 
tion suggest that 5-HT 3 receptors are involved in the modulation of different 
neurotransmitter’s release as demonstrated for noradrenaline in the hippocam¬ 
pus [53], for dopamine in the nucleus accumbens [54] and in the amygdala [55] 
and for GABA in the spinal cord [56], the hippocampus and the neocortex [57], 
The serotonergic control via 5-HT 3 receptors has also been shown on acetyl¬ 
choline release in the cerebral cortex [58, 59], on 5-HT release in the frontal 
cortex, in the hypothalamus and in the raphe nucleus [60, 61] and on glutamate 
release in the area postrema [62], 

There are many 5-HT 3 selective agonists, although they have different effica¬ 
cies depending on species. The first selective agonists were 2-methyl-5-HT (2- 
Me-5-HT), phenylbiguanide (PBG) and m-chlorophenylbiguanide (m-CPBG) 
[63-65], 2-Me-5-HT and PBG are less potent than 5-HT. Moreover, 2-Me-5- 
HT is known to have some agonist effects on other 5-HT receptor subtypes 
and PBG has been shown to be inactive on 5-HT 3 receptors in some species. 
In contrast, m-CPBG is tenfold more potent than 5-HT. Table 1 contains EC S0 
values of some of the 5-HT 3 agonists, depending on the species. 
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Table 1 Ki and EC50 values for 5-HT3 receptor agonists 


Agonist 

Ki or EC50 

Species 

Reference 

5-HT 

1,56 gM' 

Mouse** 

[159] 

5-HT 

123 nM 

Human** 

[160] 

5-HT 

219 nM 

Rat tissue homogeneate 

[161] 

2-Methyl-5-HT 

644 nM' 

Human** 

[162] 

2-Methyl-5-HT 

224 nM 

Human** 

[160] 

2-Methyl-5-HT 

562 nM 

Rat tissue homogeneate 

[161] 

Phenylbiguanide 

10,1 gM' 

Human** 

[162] 

Phenylbiguanide 

18 gM' 

Mouse* 

[163] 

Phenylbiguanide 

2,4 gM 

Human** 

[160] 

Phenylbiguanide 

135 nM 

Rat tissue homogeneate 

[161] 

m-CPBG 

480 nM 

Human** 

[162] 

m-CPBG 

400 nM' 

Mouse* 

[163] 

m-CPBG 

4,77 nM 

Rat tissue homogeneate 

[161] 

m-CPBG 

19,5 nM 

Human** 

[160] 

SR 57227A 

208 nM 

NG 108-15 

[164] 


* Expressed in Xenopus oocytes ** Expressed in HEK293 cells $ EC 50 values calcu¬ 
lated using electrophysiological techniques # EC 50 values calculated using uptake of 
[14C]Guanidinium in presence of substance P 


With respect to the antagonists, there are many highly selective and potent 
5-HTj antagonists (Tab. 2). 5-HT 3 receptor antagonists are all composed of a 
rigid aromatic or heteroaromatic ring system and a carbonyl group. A large 
number of these antagonists have been developed for the treatment of pain, 
migraine or nausea and vomiting. Concerning tropisetron, unlike MDL 72222, 
granisetron and ondansetron, this compound exhibits some blocking activity at 
5-HT 4 receptors [66], 

Activation of 5-HT 3 receptors induce major effects on the cardiovascular 
system, more precisely on the heart [67] and on blood vessels [68], Respira¬ 
tion is also influenced by this receptor through activation of pulmonary and 
carotid body chemoreflexes [69], The localization of the 5-HT 3 receptors on 
the gastrointestinal tract enable 5-HT to regulate both motility and intestinal 
secretion [70], With respect to the sensory nervous system, 5-HT 3 receptors 
induce pain and sensitization of nociceptive neurons [63], Therefore, 5-HT 3 
antagonists have been developed to treat pain, in particular migraine attacks, 
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Table 2 Kd, Ki and EC50 values for 5-HT3 receptor antagonists 


Antagonist 

Kd, Ki or IC50 Species 

Reference 

ICS 205-930 (tropisetron) 

11 nM 

Human** 

[162] 

ICS 205-930 (tropisetron) 

46 pM 

Rabbit nodose ganglion 

[165] 

ICS 205-930 (tropisetron) 

4,9 nM 

Rat tissue homogeneate 

[161] 

Granisetron 

140 pM 

Mouse* 

[163] 

Granisetron 

1,44 nM 

Human** 

[160] 

Granisetron 

5,13 nM 

Rat tissue homogeneate 

[161] 

Ondansetron 

57 pM 

Rabbit nodose ganglion 

[165] 

Ondansetron 

440 pM 

Mouse** 

[166] 

Ondansetron 

4,9 nM 

Human** 

[160] 

Ondansetron 

46,8 nM 

Rat tissue homogeneate 

[161] 

MDL-72222 

30,2 nM 

Rat tissue homogeneate 

[161] 


* Expressed in Xenopus oocytes ** Expressed in HEK293 cells $ EC 50 values calculated 
using electrophysiological techniques 


e.g., MDL72222 or granisetron [71]. 5-HT 3 has also been shown to underlie the 
nausea and vomiting associated with chemotherapy and radiotherapy. Thus, 
5-HTj antagonists (e.g., ondansetron, granisetron and tropisetron) have been 
developed to suppress these side effects induced by chemotherapeutic agents 
and radiations in cancer patients [72, 73], 5-HT 3 receptors participate in a wide 
range of physiological processes, including cognitive processing, but have also 
been implicated in psychosis, anxiety, schizophrenia, drug and alcohol abuse 
[74, 75], The cholinergic system is known to play a prominent role in cognition, 
and there is evidence that this system is inhibited by 5-HT 3 receptors. Some pre- 
clinical studies showed that 5-HT function can impair cognitive performance 
[76] and 5-HT 3 antagonists have been shown to enhance cognition and induce 
memory-enhancing effects. Evidence for a role of 5-HT in anxiety disorders 
was provided in the 1970s and 1980s. 5-HT function seems to enhance anxi¬ 
ety-related behavior [77, 78], In addition, a recent study showed that 5-HT 3 - 
knockout mice display an anxious phenotype [79], and the 5-HT 3 receptor has 
been suggested to be involved in the pathogenesis of psychiatric disorder such 
as anxiety, depression, and schizophrenia [2, 3, 80], 5-HT 3 receptors have also 
been shown to be involved in drug abuse. More precisely, 5-HT 3 antagonists 
show a reduction of morphine self administration in both naive and morphine- 
dependent rats [81]. Similar results were found for alcohol abuse. Indeed, Kos- 
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towski et al. [82] have demonstrated that low doses of tropisetron, a specific 
5-HTj antagonist, reduce ethanol consumption and preference in rats. This 
result was also confirmed in humans. However, both placebo and a wide dose 
range of ondansetron (a 5-HT 3 antagonist) administered by intravenous infu¬ 
sion before ethanol, failed to modify the effects of alcohol [83], Despite some 
evidence in animals studies [76, 84], clinical studies could not clearly confirm 
the role of 5-HT 3 receptors in schizophrenia [85], 


Role of 5-HT 3 receptors in sleep-wake physiology 

Up to now, there have been only a few studies in animals and two in humans 
that have investigated the influence of 5-HT 3 receptors on sleep-wake physi¬ 
ology. Sleep can be influenced through effects on sleep-wake alternation and 
sleep structure, but also through circadian regulations. 

Adrien et al. [9] showed that these receptors may be implicated in sleep 
in rats. They reported the effect of intraperitoneal (i.p.) injections of differ¬ 
ent doses of three different 5-HT 3 antagonists (tropisetron, MDL 72222 and 
ondansetron) on the quantity of wake, SWS and REM sleep. Tropisetron did 
not affect sleep-wake alternations, while divergent effects were obtained with 
MDL 72222 (10 mg/kg) and ondansetron (0.1 mg/kg). MDL 72222 induced 
an increase of wake and a decrease of SWS and of REM sleep. Opposite re¬ 
sults were obtained with ondansetron, i.e., a decrease of wake and an increase 
of SWS and of REM sleep. No effect of MDL 72222 or of ondansetron on 
sleep-wake parameters could be observed at other doses. The effect of ondan¬ 
setron on REM sleep correlates with the report by Tissier et al. [86], which also 
showed an increase in REM sleep induced by ondansetron in rats. 

Ponzoni et al. [10] confirmed the involvement of 5-HT 3 receptors in sleep. 
In a study in rats, they showed that intra-ventricular injection of the highly 
selective 5-HT 3 agonist, m-CPBG, is able to increase wake and to decrease SWS 
and REM sleep. These results are consistent with those of Adrien et al. [9] 
for the 5-HT 3 antagonist ondansetron. However, the results of Ponzoni et al. 
[10] obtained for MDL 72222 (0.1-1 mg/kg) are totally different from those ob¬ 
tained by Adrien et al. [9], In the Ponzoni et al. [10] study, MDL 72222 dose-de- 
pendently increased SWS. Moreover, pretreatment with MDL 72222 was able 
to block the effect of the intra-ventricular injection of m-CPBG on wake and 
sleep. Summarizing these results, 5-HT 3 receptors activation appears to increase 
wake and to decrease SWS as well as REM sleep. Nevertheless, the question of 
the structure responsible for these effects mediated by the 5-HT 3 receptors is 
still open. 

This query was partially answered by a study on the effect of bilateral injec¬ 
tion of m-CPBG into the nucleus accumbens [11], The intra-accumbens injec¬ 
tion induced an increase in wake and a decrease in SWS, but no effects on 
REM sleep, contrary to the intra-ventricular injection. Again, pretreatment 
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with MDL 72222 could block these effects of m-CPBG. Thus, one hypothesis 
of the authors is that REM sleep suppression after intra-ventricular injection 
of m-CPBG could be related to the direct activation of 5-HT 3 receptors in 
other cerebral structures, involved in the generation of REM sleep, as for ex¬ 
ample the medial pontine reticular formation. An alternative hypothesis is that 
REM sleep is indirectly inhibited through the facilitating effect of m-CPBG 
on 5-HT release. Indeed, activation of 5-HT 3 receptors in the mesencephalic 
raphe nuclei of the rat has been shown to stimulate the release of 5-HT from 
5-HT projection neurons [60, 61]. REM sleep could then be inhibited through 
activation of post-synaptic 5-HT 1A receptors located on pontine “REM-on” 
neurons [87], Whatever the case, the effect of 5-HT 3 ligands on wake and SWS 
obviously takes place in the nucleus accumbens. This conclusion is reinforced 
by the presence of a serotonergic pathway to the nucleus accumbens [88] and a 
relatively high level of 5-HT 3 receptors in this structure [89, 90], 

The same group also worked on the hypothesis that the mechanism under¬ 
lying the m-CPBG-induced increase of wake and decrease of sleep is based 
on dopamine release which would, during a second step, enhance wakefulness 
[91]. There is a close interaction of 5-HT terminals with catecholamine affer- 
ents [92], Moreover, Parsons and Justice [54] have demonstrated the influence 
of 5-HT on dopamine release in an in vitro study. In addition, direct applica¬ 
tion of the specific 5-HT 3 receptor agonist 1-phenylbiguanide into the nucleus 
accumbens induces dopamine release that can be blocked by 5-HT depletion 
with 5,7-dihydroxytryptamine. Ponzoni et al. [11] thus investigated the effect 
of pretreatment with two dopamine receptor antagonists [(+)-SCH 23390, a 
dopamine D1 receptor antagonist and YM-09151-2, a dopamine D2 receptor 
antagonist]. Pretreatment with both antagonists was able to prevent the effect 
of intra-accumbens injection of m-CPBG on wake and SWS. A further argu¬ 
ment has been provided by Monti et al. [93], Bilateral injection of m-CPBG 
into the nucleus accumbens of 6-hydroxydopamine-treated animals, which in¬ 
duces a strong depletion of dopamine, only slightly modified wake and SWS. 
These results again provide a clear evidence of the implication of dopamine in 
the m-CPBG-induced effect on wake and SWS. 

A recent report shows some evidence of 5-HT 3 -mediated regulation of cir¬ 
cadian rhythms [94], In mammals, circadian rhythms are under the influence 
of the suprachiasmatic nuclei (SCN) located in the hypothalamus and known 
to be entrained by photic (i.e., light) and non-photic cues. The retinohypotha- 
lamic tract (RHT) that extends from the retina plays a major role in the photic 
entrainment of the SCN, mainly through glutamatergic transmission [95], In 
a first study, Graff et al. [96] brought evidence for the involvement of 5-HT 
receptors located on the RHT terminals for a photic-like effect of 5-HT in rats 
[96], Degeneration of the RHT, resulting from bilateral enucleation, blocks the 
photic-like effects of the nonspecific 5-HT agonist quipazine on locomotor ac¬ 
tivity rhythm as well as on c-FOS expression in the SCN. In contrast, specific 
lesions of 5-HT input to the SCN with 5,7-dihydroxytryptamine do not abolish 
these photic-like effects of quipazine. In a second study [94], it was shown that 
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a single injection of the specific 5-HT 3 agonist m-CPBG at the end of the night 
(i.e., end of the active period) was able to induce an advance of the locomotor 
activity the following day, thus mimicking the phase-advance effect of light. 
Moreover, the same injection was able to induce the expression of c-FOS pro¬ 
tein and Perl (a well-known clock gene) RNA in the SCN. The involvement 
of 5-HTj receptors in these effects was further highlighted by the fact that pre¬ 
treatment with ondansetron was able to block the effects of m-CPBG injection 
on locomotor activity rhythm. Thus, the authors hypothesized a 5-HT 3 media¬ 
ted regulation of photic-like effect of 5-FIT on circadian rhythms. 

One may speculate that presynaptic 5-HT 3 receptors, located on RHT termi¬ 
nals induce the release of glutamate that in turn synchronizes the clock. Indeed, 
in other brain structures, the 5-HT 3 receptor is known to increase intracellular 
calcium concentrations in glutamatergic terminals thereby inducing the release 
of glutamate [49], Moreover, the authors demonstrated that NMDA receptors 
are involved in these effect on the SCN since pretreatment with MK-801, a 
specific NMDA receptor antagonist is able to block them. However, to date, 
there has been no clear demonstration of the presence of the 5-HT 3 receptor in 
the SCN [97], Presynaptic receptor mRNA should reside in cell bodies and not 
in presynaptic terminals, thus 5-HT 3 mRNA should be located in the retinal 
ganglion cells, and not in the SCN, and vice versa for the protein. Accordingly, 
Roca et al. [98] failed to detect 5-HT 3 receptors gene expression in the SCN by 
in situ hybridization, a finding consistent with a presynaptic localization of the 
5-HT3 receptors. Nevertheless, the firm demonstration of 5-HT 3 in presynaptic 
RHT terminals is still lacking. Immunohistology studies on fiber terminals of 
the ventrolateral retinorecipient area of the SCN could tackle the issue. 

Involvement in sleep mechanisms of the 5-HT 3 receptors has been confirmed 
in human studies, the results for which were grossly in accordance with these 
obtained in animals, at least for REM sleep. In the first human study, the 5-HT 3 
receptor antagonist tropisetron was administered in two different dosages (5 
and 25 mg) [12], After administration of 25 mg of tropisetron, there was a 
slight increase in REM sleep in the first part of the sleep period and stage 2 
was decreased over the whole night. Nocturnal secretory activity of growth 
hormone (GH) and cortisol that were concomitantly evaluated with sleep EEG 
were slightly altered with 25 mg tropisetron. Plasma cortisol levels increased 
earlier than under placebo, and plasma GH levels were reduced in the second 
part of the night. The authors concluded that tropisetron has only limited ef¬ 
fect on physiological sleep-EEG changes and nocturnal secretion of GH and 
cortisol. The second human study showed a significant effect of SR 57227A, a 
potent and specific 5-HT 3 agonist, on REM sleep [13], In fact, this compound 
produced a dose-dependent shift of REM sleep by lengthening of the REM 
sleep latency, by augmenting the REM sleep gravity center (average of the oc¬ 
currence of REM sleep period weighted by their duration), and, at higher doses, 
by suppressing REM sleep during the first third of the night. These REM sleep 
alteration were obtained without changing either total REM sleep duration or 
sleep continuity. Moreover, SR 57227A did not affect stage 2 or SWS. 
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To summarize, animal as well as human studies were able to demonstrate the 
involvement of 5-HT 3 receptors in sleep-wake alternation and sleep structure. 
Animal studies suggest that 5-HT 3 receptors activation in the nucleus accum- 
bens could induce a release of dopamine that subsequently increase wake and 
decrease SWS. Moreover, these receptors seem to be also involved in the regula¬ 
tion of REM sleep, but outside the nucleus accumbens. Recent studies bring 
some support for a role of 5-HT 3 receptors in circadian rhythm regulation of 
the rat. The only two human sleep studies to date bring some more evidence for 
a role of 5-HT 3 in REM sleep regulation, with antagonists tending to increase 
REM sleep propensity and agonists tending to suppress REM sleep. 


Implication of the 5-HT 3 receptor in sleep disorder 

Obstructive sleep apnea 

Partial or complete obstruction of the upper airway occurring repeatedly dur¬ 
ing sleep characterizes obstructive sleep apnea syndrome (OSAS). The preva¬ 
lence of OSAS is estimated at 4% in adult males and of 2% in adult females 
[99], It is associated with substantial cardiovascular and neurobehavioral mor¬ 
bidity, such as hypertension, congestive heart failure, cerebrovascular ischemic 
events, impaired memory, and reduced vigilance that could lead to an increased 
risk of motor vehicle accident [100-102], The mechanisms implicated in the 
upper airway obstruction are complex; these relate to collapsing forces in the 
oropharynx due to the negative intraluminal pressure generated by the respira¬ 
tion processes and to peripheral tissue weight. The sole dilating force comes 
from pharyngeal muscle activation. The physiological decrease of both tonic 
and phasic activities of pharyngeal dilator muscles during sleep is associated 
with a reduction of the upper airway capacity [103-105], As a consequence, 
during sleep, patients with OSAS rely upon upper airway dilator muscle activ¬ 
ity to avoid airway obstruction and breathe normally [106], 

There is now much evidence supporting an important role for 5-HT trans¬ 
mission in the neurochemical control of upper airway motoneurons [14]. It has 
been shown that 5-HT microperfusion increases the firing rate of upper airway 
motoneurons, while local administration of several 5-HT antagonists does the 
converse [107-109], The broad decline of 5-HT activity occurring during sleep 
also affects 5-HT neurons that innervate brainstem motoneurons; these are less 
active in non-REM sleep and almost quiescent in REM sleep [110]. Consistent 
with the hypothesis of a role of 5-HT decline in the occurrence of sleep-related 
breathing events are observations that, in rats, administration of 5-HT into the 
hypoglossal nucleus decreases sleep-related suppression of genioglossus activ¬ 
ity in REM sleep, while it fully prevents it during non REM sleep [111], Studies 
using a rat model of REM sleep-induced atonia of hypoglossal motoneurons 
have suggested that the REM-related lack of serotonergic influence is respon- 
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sible for the decreased hypoglossal activity [112,113]. In the English bulldog, a 
natural animal model of OSAS, manipulation of the 5-HT tone with different 
agents (methysergide, ritanserin, 1-tryptophan, trazodone) suggested that the 
maintenance of a patent upper airway requires 5-HT activity [114], and that 
a dose-dependent reduction in obstructive sleep-disordered breathing can be 
obtained with drugs enhancing 5-HT tone [115]. 

The 5-HT receptor subtypes specifically involved in these effects still need to 
be determined. The pharmacology is complicated by the fact that 5-HT controls 
respiration at many sites within the central and peripheral nervous systems. Ex¬ 
citatory effects of 5-HT have been observed for brainstem respiratory neurons, 
possibly through activation of 5-HT 2 and 5-HT 1A receptors [14], At the level 
of the hypoglossal nucleus, there is evidence for an excitatory role of 5-HT 2A 
receptors and, to a lesser extent, of 5-HT 2C receptors [116, 117], while the role 
of 5-HT, receptors is less well defined. Systemically administered 5-HT 3 recep¬ 
tor antagonists increase hypoglossal activity, while locally microinjected 5-HT 3 
agonists and antagonists into the nucleus do not affect the activity of hypoglos¬ 
sal neurons [118]. Since it has been further demonstrated that 5-HT 3 receptors 
are not present on hypoglossal motoneurons [119], it has been proposed that 
5-HT 3 antagonists could increase hypoglossal activity through 5-HT 3 receptors 
located on inhibitory interneurons outside the hypoglossal nucleus [14], 

In contrast to the predominant excitatory effect of 5-HT at upper airway 
dilator motoneurons and at brainstem respiratory neuronal groups, increasing 
peripheral 5-HT tone has been shown to increase spontaneous apnea during 
REM sleep in rats [120], Evidence suggests that the nodose ganglia is a likely 
site that may account for the observed apnea-promoting effect of 5-HT. The 
nodose ganglia is critical in relaying information coming from specialized sen¬ 
sory endings of the vagus nerve to the CNS for maintenance of visceral func¬ 
tions, including breathing regulation. Thus, stimulation of vagal afferent C fi¬ 
bers in anesthetized cats can produce central apnea [121], and this effect can be 
reproduced by applying 5-HT to the nodose ganglia [122], The administration 
of either 5-HT 2 or 5-HT 3 receptor antagonists prevents these apneas [123], In 
rats, two studies strongly suggest that the 5-HT 3 antagonist ondansetron re¬ 
duces the number of REM generated central sleep apnea through a peripheral 
mechanism that is consistent with activation of the nodose ganglion [120, 124], 
In the same way, ondansetron has been shown to reduce the number of REM 
sleep-related disordered breathing events in English bulldog [125], 

To summarize, the available data on the 5-HT control of respiration suggest 
that the central effects of 5-HT is principally excitatory, whereas, at the periph¬ 
ery, the effect of 5-HT is mostly inhibitory. These central and peripheral mecha¬ 
nisms both involve 5-HT 2A/c and 5-HT 3 receptors, with 5-HT 2A/c having opposite 
effects in central and peripheral regions. In contrast, 5-HT 3 antagonists appear 
to augment respiration through a seemingly unopposed effect, since it decreases 
inhibitory influence both at the center and at the periphery. Accordingly, drugs 
having antagonistic properties at the 5-HT 3 receptor site could be of thera¬ 
peutic potential in OSAS. Up to now, clinical trials using various drugs acting 
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on 5-HT neurotransmission have brought disappointing results compared to 
nasal continuous positive airway pressure, the “Gold Standard” treatment for 
patients with OSAS. Drugs such as L-tryptophan [126], the 5-HT 1A partial ago¬ 
nist buspirone [127], and the SSRIs fluoxetine [128] and paroxetine [129] have 
shown to reduce the sleep respiratory disturbance index by about 20-40% with 
a tremendous variability in response, some patients even worsening their index 
[127, 128], Trials are presently being conducted to evaluate the effects of 5-HT 2 
and 5-HT 3 antagonists in OSAS. The results of a pilot placebo-controlled study 
with ondansetron have already been published [130] and showed its lack of ef¬ 
ficacy in OSAS. This was a single-dosing study on a small sample size («=10) of 
patients having slight to moderate OSAS. Moreover, ondansetron was admin¬ 
istered at about 10% of the dose proved to be efficient in the English bulldog 
[125], Most impressive results were recently obtained with mirtazapine a mixed 
5-HT 2 /5-HT 3 antagonist that also slightly promotes 5-HT release [131], After a 
1-week administration of either 4.5 or 15 mg mirtazapine, the sleep respiratory 
disturbance index was reduced by half. This effect was very consistent since 
mirtazapine significantly reduced the index in all sleep stages and 23 up to 24 
patients showed improvement over placebo. 


Fibromyalgia 

Fibromyalgia is a painful syndrome of nonarticular origin, characterized by 
fatigue and widespread musculoskelatal pain, tiredness, and sleep disturbances, 
with the presence of tender points on physical examination. The clinical criteria 
for fibromylagia state a history of widespread musculo-skeletal pain for at least 
3 months with concomitant tenderness found in at least 11 of 18 anatomically 
defined sites, the tender points [132], The disease has a prevalence of 2.1-5.7% 
and is characterized by a chronic course frequently leading to a marked impair¬ 
ment of normal physical activity as well as work incapacity [133-135], A key 
component of fibromylagia syndrome is unrefreshing sleep. Objective sleep 
disturbances in fibromyalgia are prolonged sleep latencies, low sleep efficiency, 
reduction of SWS and of REM sleep, and an increase in alpha EEG activity 
during non-REM sleep [136], 

There is extensive evidence supporting the concept that 5-HT 3 receptors are 
implicated in the perception and processing of pain. In the CNS, 5-HT 3 recep¬ 
tors are located at key spinal and brain regions involved in pain transmission 
and pain suppression. However, their exact function in pain modulation has 
not been accurately explained, and studies have yielded partly conflicting re¬ 
sults. For instance, in acute pain models, the stimulation of 5-HT 3 receptors 
in the dorsal horn has antinociceptive activity that is abolished by administra¬ 
tion of 5-HT 3 antagonists, but there are also contradictory results [1], Chronic 
rather than acute pain is involved in fibromyalgia syndrome. Acute pain re¬ 
sults from direct thermal, mechanical, or chemical activation of nociceptors, 
whereas the persistent component of the pain response is associated with the 
release of multiple inflammatory factors including neurotransmitters such as 
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5-HT. Tissue injury causing the release of 5-HT produces pain per se and po¬ 
tentiates the algesic effect of other substances, such as substance P, bradykinin, 
and calcitonin gene-related peptide [137], 

Convincing evidence suggests that 5-HT 3 receptor located on peripheral sen¬ 
sory neurons are involved in inflammatory pain since several selective antago¬ 
nists have shown an inhibition of the nociceptive effect of 5-HT [63, 138, 139], 
In a 5-HT 3A knockout mice study that combined pharmacological and genetic 
disruption of the 5-HT 3 transmission, Zeitz et al. [140] demonstrate that per¬ 
sistent, but not acute, tissue injury-induced nociception is significantly reduced 
after functional elimination of this receptor subtype. Overall these findings are 
in accordance with the idea that 5-HT 3 receptor located on peripheral sensory 
neurons could be implicated in the modulation of chronic pain that relates to 
inflammatory processes. 

One large multicenter placebo-controlled double-blind study performed in 
Germany demonstrated the efficacy of the 5-HT 3 receptor antagonist tropise- 
tron in 418 patients suffering from fibromyalgia syndrome [141], After 10 days 
of treatment, a bell-shaped dose response curve was observed with only the 
lowest dosage (5 mg) showing efficacy. Among the initial cohort, 78 treatment 
responders were further followed up for 12 months. Interestingly, pain inten¬ 
sity rose within 1 month in all treatment groups, but to a lesser extent in the 
two lowest dosage groups (5 and 10 mg) compared to the placebo and 15 mg 
groups. Similar results showing efficacy of 5 mg tropisetron were observed in 
two 4-week open-label studies with more modest sample size [142], as well as 
with intravenous application of tropisetron [143], In an event-related func¬ 
tional magnetic resonance study, tropisetron was shown to lower the activation 
of pain-related processing area of patients with fibromyalgia during painful 
mechanical stimulation [144], Finally, another drug having 5-HT 3 -blocking 
potency, mirtazapine, demonstrated a beneficial effect on the intensity of 
fibromyalgia symptoms in a 6-week open-treatment study [145], 

Of particular note is the fact that the therapeutic effects of 5-HT 3 receptor 
antagonists in fibromyalgia are not limited to pain reduction but also include 
improvement in sleep disturbances, daytime fatigue and various autonomic/ 
functional symptoms [146], Pain-inhibiting effects of 5-HT 3 receptor antago¬ 
nists seem to be related to substance P-mediated inflammation and hyperal¬ 
gesia. Indeed, 5-HT 3 receptor antagonists have been shown to inhibit sensory 
neuropeptides release, such as neurokinin A, substance P and calcitonin gene- 
related peptide [147], and to prevent unmasking of autonomous tachykinin 
NK 2 receptors [148]. The beneficial effects of 5-HT 3 receptor antagonists in 
fibromyalgia syndrome are supposed to be related to substance P pain modula¬ 
tion [141, 143]; importantly, Stratz et al. [149] show in patients with fibromyal¬ 
gia that blood level of substance P was predictive of 5-HT 3 antagonist response. 
Evidence suggests that 5-HT 3 modulation of substance P level could also play 
a role in the sleep improvement effects of 5-HT 3 antagonist in fibromyalgia. 
First, levels of substance P, tryptophan and 5-HIAA in the blood have been 
correlated with various degree to pain, sleep quality and sleep disturbances in 
patients having fibromyalgia [150], Second, human and animal data suggested 
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that substance P has a disrupting effect on sleep [151, 152], Third, the decrease 
of substance P observed after the effects of massage therapy in patients with 
fibromyalgia has been shown to correlate with both pain and sleep improve¬ 
ment [153], 


Conclusion 

The complex role of 5-HT in the regulation of sleep could be accounted for 
by the fact that this neurotransmitter acts on several subtypes of 5-HT recep¬ 
tors with different effects on sleep physiology. Among them, the 5-HT 3 receptor 
takes up a particular place since it is the only ligand-gated ion channel and it 
mediates fast 5-HT synaptic transmission. Within the CNS, 5-HT 3 receptors 
are expressed in many areas and are either postsynaptic or presynaptic. Al¬ 
though many studies have addressed the role of 5-HT IA(B and 5-HT 2A/c in REM 
and SWS regulation [87,154-158], the specific contribution of 5-HT 3 receptors 
in sleep-wake mechanisms remains largely unknown. A rather consistent effect 
of 5-HT 3 ligands across animal and human studies is on REM sleep regula¬ 
tion. Animal studies also suggest that activation of 5-HT 3 receptors induces 
wake and decreases SWS. 5-HT 3 presynaptic receptors that mediate the release 
of neurotransmitters such as dopamine and 5-HT itself could account for the 
effects of 5-HT 3 ligands on sleep, although direct evidence supporting this hy¬ 
pothesis is lacking. 

During the last decade, interest in 5-HT 3 receptors ligands as potential treat¬ 
ments in the field of sleep medicine has grown, with results of animal and hu¬ 
man studies suggesting that drugs antagonizing 5-HT 3 receptors could be effec¬ 
tive in the treatment of sleep apnea and of fibromyalgia syndrome. Animal data 
suggest that 5-HT 3 antagonists appear to augment respiration through a dual 
mechanism, since it increases central 5-HT excitatory influences at upper airway 
dilator motoneurons and decreases peripheral 5-HT inhibitory influences at the 
level of the nodose ganglia. Results of the 1-week clinical trial conducted with 
the mixed 5-HT 2 /5-HT 3 antagonist mirtazapine in OSAS are promising since 
the sleep respiratory disturbance index was reduced by half [131], On another 
hand, these results are still disappointing since it is thought that treatment suc¬ 
cess require reducing the respiratory disturbance index to less than five events 
per hour. Indeed, it has been shown that the cardiovascular risk in patients with 
OSAS is as substantial for an index of 5 as it is for an index of 20 or 40 [102], It 
has been shown that 5-HT 3 receptors are implicated in the perception and pro¬ 
cessing of pain, and in particular to the modulation of chronic pain that relates 
to inflammatory processes. There is now some evidence that the 5-HT 3 receptor 
antagonist tropisetron had beneficial effects on pain intensity in patients with 
fibromyalgia symptoms. This therapeutic effect is not limited to pain reduction 
but also include improvement in sleep disturbances and could relate to modula¬ 
tion of substance P level through 5-HT 3 receptors. 
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Abstract 

The 5-HT 7 receptor class is one of seven major subtypes of 5-HT receptor (5-HT,_,) exhi¬ 
biting a distinct profile in terms of structural properties, functional coupling and pharma¬ 
cology. The receptor is widely localized in the brain and is expressed neuronally, in both 
terminal and cell body regions, in a number of brain areas relevant to sleep including, 
pyramidal neurons of the hippocampus, the suprachiasmatic nucleus (SCN) of the hypo¬ 
thalamus and the dorsal raphe nucleus (DRN). Brain functional studies utilizing 5-HT, 
receptor-selective antagonists suggest the 5-HT, receptor plays a role in modulating 5-HT 
neuronal activity in the DRN, a brain area implicated in the control of sleep. Thus, altera¬ 
tion in 5-HT, receptor function might indirectly modulate sleep architecture. Consistent 
with this possibility, systemic administration to rats of selective 5-HT 7 receptor antagonists 
such as SB-269970, increases the latency to onset of REM sleep and reduces the density of 
REM sleep, without significant effects on other sleep parameters. A qualitatively similar 
profile has been reported in 5-HT,-/- knockout mice, which spend less time in REM sleep 
without alteration in wakefulness or slow-wave sleep. Microinjection of SB-269970 into 
the DRN in rats produces effects on REM sleep consistent with those observed following 
systemic administration. These findings support a role for 5-HT, receptors in the DRN in 
the mechanisms underlying REM sleep formation. To date, no clinical studies have been 
carried out that investigate the therapeutic potential of selective 5-HT, receptor ligands. 
However, based on the pre-clinical findings, it is tempting to speculate that such ligands 
might exhibit utility in disorders where disrupted REM sleep is a feature. 
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Introduction to 5-HT 7 receptors 

5-HT 7 receptor gene localization, structure and sequence polymorphisms 

The 5-hydroxytryptamine 7 (5-HT 7 ) receptor gene is located on human chromo¬ 
some 10q23.3-q24.4 and has two introns in the coding region. One intron is 
located after the putative third transmembrane domain (second intracellular 
loop) and the other near the C terminus. A number of polymorphisms in the 
5-HT 7 receptor gene have been reported [1], Two such polymorphisms, Pro- 
279 Leu (third intracellular loop) and Thr 92 Lys (first transmembrane domain) 
have been reported to give rise to alterations in the function of the receptor 
(without affecting receptor density) when expressed in recombinant systems, 
revealed as a reduced potency and maximal response to agonists [2, 3], How¬ 
ever, the relevance, or otherwise, of these polymorphisms to the physiological 
functions of the receptor has not been clearly established. 


5-HT 7 receptor cloning, isoforms and species homologues 

The 5-HT 7 receptor class is one of seven major subtypes of 5-HT receptor 
(5-HT,_ 7 ), each showing a distinct profile in terms of structural properties, 
functional coupling and pharmacology [4], The 5-HT 7 receptor has been cloned 
from the mouse, rat, guinea pig, pig and human genome. The full-length mam¬ 
malian 5-HT 7 receptor is a protein of 445-479 amino acids with seven putative 
transmembrane spanning regions and shows low (<40%) sequence homology 
versus other 5-HT receptors. Alternative splicing of the 5-HT 7 receptor gene in 
rat and human gives rise to a number of isoforms, namely 5-HT 7(a) (b)j (c) in rat 
and 5-HT 7(a) ^ (d) in human [5], The 5-HT 7(a) and 5-HT 7(b) isoforms are homolo¬ 
gous in rat and human. The 5-HT 7(b) isoform represents a “short” form due to 
a 5-bp insert (GTAAG) resulting in a premature stop codon. The third isoform 
in rat and human (5-HT 7(c) and 5-HT 7(d) , respectively) arises from the presence 
of an additional 97- or 98-bp sequence. In contrast, to date, only one 5-HT 7 
receptor isoform has been identified in mouse and guinea pig representing a 
species homologue of the human 5-HT 7(a) splice variant. 


5-HT 7 receptor pharmacology and functional coupling 
in recombinant systems 

The pharmacological profile for cloned 5-HT 7 receptors appears very similar 
across both species and splice variants. The receptor is typically characterized 
by the high potency of the non-selective agonist, 5-CT, and the selective ant¬ 
agonist, SB-269970A [6] (Tab. 1). Recombinant 5-HT 7 receptors couple via G s 
to adenylyl cyclase (AC), leading to an increase in cAMP production [7], Ad¬ 
ditionally, the 5-HT 7(a) isoform has been reported to couple to the activation 
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Table 1 Antagonist tool compounds used to study the role of the 5-HT, receptor in 
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Structure 
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P K, 

Selectivity profile In vivo 

PK profile 

Refer- 

SB-258719 

*V..O' 

6T 

7.5 

100-fold versus 
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tors except 5-HT 1D rat 
(10-fold), 5-HT 2A 
(30-fold); Hista¬ 
mine! (<30-fold) 

[li¬ 

es] 




of extracellular signal-regulated kinase (ERK) [8], although it has not been 
established whether the other 5-HT 7 receptor isoforms are able to couple in this 
manner. 


Selective 5-HT 7 receptor ligands as tools to study 
the physiological role of the 5-HT 7 receptor 

Investigation of the physiological role of the 5-HT 7 receptor has been aided by 
the discovery of a number of potent and selective 5-HT 7 receptor antagonists. 
SB-258719, the first selective 5-HT 7 receptor antagonist to be identified [9], dis¬ 
plays moderately high affinity for the human 5-HT 7(a) receptor and 100-fold 
selectivity versus a range of other 5-HT and non-5-HT receptors (Tab. 1). SB- 
269970-A, a more potent analogue of SB-258719, was subsequently identified 
[10], and also shows 100-fold selectivity versus other 5-HT receptor subtypes 
apart from the 5-ht SA receptor (50-fold), However, SB-269970-A is not ideal 
as a tool for in vivo studies due to its short half life (<0.5 h). Further, struc¬ 
ture-activity studies based around SB-269970-A led to the identification of SB- 
656104-A [11] (Tab. 1). SB-656104-A is less selective than SB-269970-A for the 
5-HT 7 receptor, showing moderate affinity for the 5-HT 1D and 5-HT 2A receptor 
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subtypes as well as the histamine H, receptor (author’s unpublished observa¬ 
tion) but exhibits a longer plasma t 1/2 compared to SB-269970-A and therefore, 
in this respect, is a better tool for in vivo studies. 


5-HT 7 receptor brain tissue localization 

Brain regional distribution of 5-HT 7 receptor mRNA and protein 

Brain localization studies in human and rodent species have revealed wide¬ 
spread expression of 5-HT 7 receptor mRNA particularly in the cerebral cortex, 
hippocampus, amygdala, thalamus and hypothalamus [7, 12-14], This signal is 
mainly comprised of the 5-HT 7(a) and 5-HT 7(b) receptor splice variants, which 
make up >95% of the total 5-HT 7 receptor mRNA content in both human and 
rat brain [15]. Findings from immunolocalization studies in the rat are generally 
consistent with the 5-HT 7 receptor mRNA brain distribution pattern [16] and 
a similar pattern has also been reported in autoradiographic studies in rat and 
guinea pig using the non-selective agonist radioligand [ 3 H]5-CT [17, 18]. Brain 
homogenate binding studies using the selective antagonist radioligand, [ 3 H]SB- 
269970 [19] have confirmed receptor expression across rodent, pig and primate 
species, including human [20], Furthermore, [ 3 H]SB-269970 autoradiographic 
studies in human brain have revealed an expression pattern consistent with that 
in rodent species, receptor expression being detected in the anterior thalamus, 
hippocampus (particularly dentate gyrus), amygdala and hypothalamus [21], 


5-HT 7 receptor expression in brain regions implicated in the control of sleep 

The 5-HT 7 receptor has been reported to be expressed neuronally, in both ter¬ 
minal and cell body regions, in a number of rat brain areas implicated in sleep 
including, pyramidal neurons of the cerebral cortex, hippocampus (CA, and 
CA 3 ) and thalamus [16]. 5-FIT, receptor mRNA expression has also been re¬ 
ported in the rat suprachiasmatic nucleus (SCN) [5, 16] and has been shown 
to co-localize with GAD67 immunoreactivity (a marker of GABAergic neu¬ 
rons) [22], Consistent with this finding, immunocytochemistry studies in the 
mouse showed the receptor to be expressed both on GABAergic neuronal cell 
bodies and nerve terminals [as well as vasoactive intestinal polypeptide (VIP) 
and vasopressin-expressing neurons] within the SCN [23], In addition to their 
neuronal localization, there is evidence that 5-HT 7 receptors are localized on 
glial cells in the CNS [24, 25], Immunocytochemistry studies have revealed that 
5-HT 7 receptors are localized on glial cells in the mouse SCN [23]. 

Binding studies in the hamster using the non-selective agonist radioligand 
[ 3 H]8-OH-DPAT show 5-HT 7 receptor expression in a number of other regions 


5-HT 7 receptor modulation of sleep patterns 


443 


of the circadian timing system in addition to the SCN, i.e., the intergeniculate 
leaflet (IGL) and dorsal (DRN) and median (MRN) raphe nuclei [26], In the 
DRN, 5-HT 7 receptors show an age-related decline in expression level [26] and 
do not appear to co-localize with 5-HT [27], suggesting that the receptor might 
instead be localized on GABAergic neurons, as reported in the SCN. Although, 
to date, there are a lack of data regarding the precise localization pattern of 
the 5-HT 7 receptor in the DRN, functional studies support the concept that the 
receptor is localized, at least in part, on GABAergic neurons in this nucleus (see 
below: 5-HT autoreceptor and GABAergic modulation of 5-HT neuronal activity 
in the DRN). 


5-HT 7 receptor modulation of neuronal activity 
in brain regions implicated in sleep 


Consistent with the aforementioned expression data, biochemical, electrophysio- 
logical and in vivo behavioural studies have provided evidence that the 5-HT 7 
receptor plays a role in modulating neuronal function in a number of brain 
areas implicated in the control of sleep and circadian rhythms, including the 
hippocampus, thalamus, cerebral cortex, SCN and DRN. This section reviews 
the data supporting a modulatory role for the receptor in these brain regions, in 
particular the SCN, the site of the circadian pacemaker, and the DRN, which is 
implicated in the control of REM sleep. 


Evidence for functional coupling of brain 5-HT 7 receptors 

Consistent with the findings from studies in recombinant systems and follow¬ 
ing the cloning of the guinea pig 5-HT, receptor, a “5-HT 7 -like” receptor was 
reported to mediate the stimulation of AC in the guinea pig hippocampus [28], 
defined on the basis of potent agonism by 5-CT and antagonism by the non-se- 
lective antagonist, methiothepin. This 5-CT-induced response was subsequently 
confirmed to be 5-HT 7 receptor-mediated based on the potent antagonism of 
the response by SB-258719 [29] and SB-269970-A [6], A similar response has 
also been reported in the rat hippocampus [30], In addition, the 5-HT, receptor 
appears to couple, via G s , to the stimulation of ERK1 and ERK2 in rat hippo¬ 
campal neurons [31]. Interestingly, it appears that the receptor may also be able 
to couple to other G protein subtypes in native tissues. In this regard, it has 
been reported that regulation by 5-HT of neuronal morphology in mouse hip¬ 
pocampal neurons, including the 5-HT-induced increase in neurite outgrowth, 
is mediated via 5-HT, receptors coupling to the G protein subtype, G 12 , leading 
to activation of RhoA and Cdc42 GTPases [32], 
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5-HT 7 receptor modulation of hippocampal, 
thalamic and cerebrocortical function 

Consistent with the studies showing that the 5-HT 7 receptor is coupled to the 
stimulation of AC in the hippocampus, a number of studies have reported that 
5-HT 7 receptors play a role in modulating neuronal excitability in the hippo¬ 
campus and other brain areas implicated in the etiology of sleep. The recep¬ 
tor mediates the 5-CT-induced decrease in slow after-hyperpolarization current 
(I sAHP ) in rat hippocampal CA 3 neurons via a mechanism thought to involve di¬ 
rect inhibition of calcium-activated K + channels [33], This, in turn, results in an 
increase in neuronal excitability revealed as an increase in the frequency of epi¬ 
leptiform bursting activity [34], 5-HT 7 receptor-mediated inhibition of I sAHP has 
also been reported in rat intralaminar and midline thalamic neurons [35], The 
receptor has also been reported to modulate the hyperpolarization-activated 
current, I h in anterior thalamic neurons [36, 37], In addition, the receptor has 
been reported to play a role in mediating the depolarization of pyramidal neu¬ 
rons in developing rat prefrontal cortex [38], Taken together, the above findings 
suggest that the 5-HT 7 receptor plays a key role in mediating the 5-HT-induced 
modulation of neuronal excitability in a number of brain regions involved in 
the etiology of sleep. 


5-HT 7 receptor modulation of SCN function 

The SCN functions as the circadian pacemaker in mammals [39] and receives 
a serotonergic neuronal input from the midbrain raphe nuclei that modulates 
the retinal input to the SCN, diminishing the sensitivity of the circadian clock 
to photic input [40], 5-HT receptor agonists produce non-photic phase shifts of 
circadian rhythms, and pharmacological data from in vitro and in vivo studies 
suggest that these effects may be mediated, at least in part, via 5-HT 7 receptors. 
In support of this, 8-OH-DPAT- and 5-CT-induced phase advances of circa¬ 
dian rhythms in the rat [41] and hamster [42-44] can be attenuated by the 5-HT 7 
receptor antagonists, ritanserin and SB-269970. It has also been reported that 
(R)-(+)8-OH-DPAT-induced circadian phase shifts in the hamster can be mim¬ 
icked by the stable cAMP analogue, 8-Br-cAMP, also consistent with the in¬ 
volvement of the 5-HT 7 receptor [45], The 5-HT 7 receptor modulation of non- 
photic phase-resetting responses appears to occur at the level of the DRN and 
MRN since targeted injections of 5-HT 7 receptor antagonists into the DRN or 
MRN in the hamster have been reported to attenuate circadian phase advance 
shifts and 5-HT release in the SCN [44, 46]. 

The 5-HT 7 receptor has been reported to modulate GABA neuronal func¬ 
tion in the rat SCN [47] and consistent with this, appears to co-localize with 
GABA [22], The precise intracellular events that occur following activa¬ 
tion of 5-HT 7 receptors in the SCN have not yet been established, although 
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receptor activation has been reported to generate an increase in cAMP, 
activation of protein kinase A and an increase in K + conductance in SCN neu¬ 
rons [48], 

A caveat in relation to the pharmacological studies supporting a role for 
the 5-HT 7 receptor in SCN function is that the 5-HT 7 receptor shares a simi¬ 
lar pharmacological profile with the 5-ht SA receptor [10, 49], which has also 
been suggested to play a role in the control of circadian timing. In particular, 
SB-269970 and ritanserin, which have been used to characterize 5-HT 7 recep¬ 
tor-mediated functional responses, also show affinity for the 5-ht SA receptor 
subtype [50], Furthermore, species differences have been reported with respect 
to the precise 5-HT subtypes involved in the control of circadian rhythms. Al¬ 
though available evidence strongly suggests a role for the 5-HT 7 receptor in 
serotonergic-induced circadian phase shifts in the rat and hamster SCN, 5-HT 7 
receptor knockout studies in the mouse have provided conflicting data with 
studies concluding that either the 5-HT 7 receptor [51] or the 5-ht SA receptor 
[50] play a predominant role in mediating serotonergic-induced circadian phase 
shifts in the mouse. Further studies with highly selective tools are required to 
establish the role of the 5-HT 7 receptor and other 5-HT receptor subtypes, such 
as the 5-ht 5A receptor, in the control of circadian rhythms. 


5-HT receptors and modulation of DRN function 

Dorsal raphe 5-HT neurons have been implicated in the control of a number of 
higher physiological functions including sleep [52], Their excitability is known 
to vary with the sleep-wake cycle, in that activity is highest during waking, in¬ 
termediate during non-REM (NREM) sleep and lowest during REM sleep [53], 
It follows, therefore, that factors that modulate dorsal raphe neuronal activity 
could potentially modulate sleep parameters such as REM sleep. 


5-HT autoreceptor and GABAergic modulation of 5-HT neuronal 
activity in the DRN 

The neuronal excitability of dorsal raphe 5-HT neurons is regulated by a nega¬ 
tive feedback system controlled by multiple 5-HT autoreceptors localized on 
both 5-HT neuronal cell bodies and terminals. Inhibitory 5-HT 1A , 5-HT 1B and 
5-HT 1D autoreceptors have been reported to be localized on cell bodies and/or 
dendrites of serotonergic neurons, with 5-HT 1B/D autoreceptors also localized 
on serotonergic terminals [54], In contrast, the 5-HT 7 receptor appears to play 
an indirect heteroreceptor role in the modulation of 5-HT release in the DRN 
(see below). 

In addition to 5-HT autoreceptor function, GABAergic inhibitory tone has 
been identified as a key mechanism within the DRN controlling 5-HT neu- 
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ronal activity [55, 56], GABAergic intemeurons within the DRN as well as 
GABAergic afferents arising from other brain areas such as the pontine re¬ 
ticular formation have been reported to contribute to this inhibitory tone [57], 
The GABAergic inhibition of 5-HT neuronal activity within the DRN leads 
to the disinhibition of “REM-on” neurons in the pedunculopontine tegmental 
nucleus (PPT) and laterodorsal (LDT) tegmental nuclei in the mesopontine teg¬ 
mentum resulting in the onset of REM sleep [58], The GABAergic inhibition 
of 5-HT neurons in the DRN has also been reported to inhibit 5-HT release in 
the SCN, so modulating non-photic circadian phase shifts [46, 59], In addition, 
the activity of 5-HT neurons in the DRN has been reported to be controlled by 
an excitatory glutamatergic input [56], although this has been less well charac¬ 
terized than the GABAergic input. 


5-HT 7 receptor modulation of 5-HT neuronal activity in the DRN 

To date, functional studies suggest that the 5-HT 7 receptor plays an indirect role 
in the modulation of DRN 5-HT neuronal excitability, which may involve the 
modulation of GABAergic inhibitory tone. In support of this possible mecha¬ 
nism, intra-DRN application of the 5-HT 7 receptor antagonists, metergoline 
or DR-4004 [60], attenuated the increase in 5-HT release in the SCN resulting 
from electrical stimulation of DRN cells, effects that were mimicked by musci¬ 
mol [46], In addition, voltammetric studies on 5-HT release in guinea pig DRN 
slices have shown that SB-269970-A inhibits 5-HT release and that this effect is 
attenuated by the GABA a receptor antagonist, bicuculline [61]. Furthermore, 
in the same study, the inhibitory effects of SB-269970-A and the GABA a recep¬ 
tor agonist, muscimol, were not additive [61]. Although localization of 5-HT 7 
receptors with GABAergic neurons in the DRN has not yet been confirmed, 
these functional studies imply that 5-HT 7 receptors may be localized, at least 
in part, on GABAergic neurons in the DRN. Consistent with this hypothesis, 
immunolocalization studies suggest 5-HT 7 receptors are not localized directly 
on dorsal raphe 5-HT neurons [27], 

In contrast to the above findings that suggest that 5-HT 7 receptors exert a 
stimulatory influence on 5-HT neuronal activity in the DRN, findings from 
[ 3 H]5-HT release studies in rat DRN slices suggest that 5-HT 7 receptors may 
mediate the inhibition of 5-HT neuronal activity in the dorsal raphe [62], Based 
on these studies, it has been suggested that 5-HT 7 receptor-mediated inhibition 
of 5-HT release in the rat DRN may occur via inhibition of glutamatergic neu¬ 
rons, although there appears to be no direct evidence for this mechanism. 

In summary, the most widely accepted view is that 5-HT 7 receptors play a 
role in the control of dorsal raphe 5-HT neuronal activity via an indirect mech¬ 
anism involving the modulation of GABAergic neuronal tone, although gluta¬ 
matergic pathways may also be involved. Clearly, further studies are required to 
clarify the precise role of the 5-HT 7 receptor in this regard. 
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Evidence for a role for the 5-HT 7 receptor in sleep modulation 


As already described above, the GABAergic inhibition of 5-HT neurons in the 
DRN and the resulting disinhibition of cholinergic “REM-on” neurons in the 
PPT and LDT nuclei has been identified as a key neuronal pathway modulating 
REM sleep [58], If indeed there is a role for the 5-HT 7 receptor in DRN func¬ 
tion, then it follows that modulation of 5-HT 7 receptor function might lead, 
indirectly, to the modulation of sleep architecture. This possibility provided the 
rationale for studies to investigate the effect of selective 5-HT 7 receptor antago¬ 
nists on sleep parameters in rats and studies to compare sleep architecture in 
wild-type and 5-HT,-'- knockout mice. 


Effect of 5-HT 7 receptor antagonists on sleep parameters in vivo 

Both SB-269970-A and SB-656104-A, when administered systemically to rats 
at the beginning of the sleep phase, increased the latency to onset of REM 
sleep and reduced the density of REM sleep without significant effects on 
other sleep parameters (Figs 1^1) [6, 63], Similar effects have been reported 
in 5-HT ? -'- knockout mice which spent less time in REM sleep without changes 
in wakefulness or slow-wave sleep (SWS) [64], Furthermore, in the knockout 
mice the REM sleep episodes were less frequent than in the wild-type mice but 
longer in duration. These findings provide support for a role of the 5-HT 7 re¬ 
ceptor in mechanisms underlying REM sleep formation. 


Evidence for the involvement of DRN 5-HT 7 receptors 
in the modulation of REM sleep 

More recent studies have been carried out to investigate the site of action of 
5-HT 7 antagonists in the modulation of REM sleep parameters, in particular 
the potential role of 5-HT 7 receptors in the DRN. Microinjection of SB-269970 
into the DRN in rats during the light phase has been reported to increase REM 
sleep latency and reduce the number of REM sleep periods [65], In contrast, 
SWS and other NREM sleep parameters were not significantly affected (see 
Fig. 3). These findings are consistent with the effects on REM sleep observed 
following systemic administration of selective 5-HT 7 receptor antagonists and 
support the possibility that 5-HT 7 receptors in the DRN play a role in the modu¬ 
lation of REM sleep. 

In the same study it was also reported that the GABA a receptor agonist 
muscimol prevented SB-269970-induced decreases in REM sleep; a finding that 
appears to contradict data from previous studies suggesting that 5-HT 7 recep¬ 
tor antagonists mimic the effect of muscimol in the DRN [46, 61]. The reason 
for this discrepancy is unclear, but could be due, at least in part, to the differing 
methodologies used in these studies. 
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Fig. 1 Effect of SB-269970-A on NREM sleep and REM sleep latency (mean ± s.e.m.) 
during the physiological sleep phase. Vehicle or SB-269970-A (30 mg/kg) were admi¬ 
nistered orally at the beginning of the sleep phase (CT 0, 14:00 h) to eight animals, 
following a Latin square experimental design. Statistical significance was assessed by 
ANOVA, followed by Dunnet’s test. **p<0.01 compared to vehicle-treated control ani¬ 
mals 



vehicle SB-269970-A 


Fig. 2 Effect of SB-269970-A on REM sleep distribution, during the first 5 h of the 
physiological sleep phase. Data (mean ± s.e.m.) are expressed as minutes spent in REM 
sleep phase for each of the hours or as the total amount (min) in the recorded window. 
Vehicle or SB-269970-A (30 mg/kg) was administered orally at the beginning of the sleep 
phase (CT 0, 14:00 h) to eight animals, following a Latin square experimental design. 
Statistical significance on the total amount of REM sleep was assessed by ANOVA, fol¬ 
lowed by Dunnet’s test. **p<0.01 compared to vehicle-treated control animals 















5-HT 7 receptor modulation of sleep patterns 


449 


REM latency 


2i °: T 

[Lll'toll 


SB-656104-A 

(mgkg-1) 


SB-656104-A 
(mgkg-1) 


Fig. 3 Effect of SB-656104-A on NREM sleep and REM sleep latency (mean ± s.e.m.) 
during the physiological sleep phase. Vehicle or SB-656104-A (10 and 30 mg/kg) were 
administered orally at the beginning of the sleep phase (CT 0, 14:00 h) to eight animals, 
following a Latin square experimental design. Statistical significance was assessed by 
ANOVA, followed by Dunnet’s test. **p < 0.01 compared to vehicle-treated control ani¬ 
mals (Data are from [63]) 
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Fig. 4 Effect of SB-656104-A on REM sleep distribution, during the first 5 h of the 
physiological sleep phase. Data (mean ± s.e.m.) are expressed as minutes spent in REM 
sleep phase for each of the hours or as the total amount (min) in the recorded window. 
Vehicle or SB-656104-A (10 and 30 mg/kg) was administered orally at the beginning of 
the sleep phase (CT 0, 14:00 h) to eight animals, following a Latin square experimental 
design. Statistical significance on the total amount of REM sleep was assessed by ANO¬ 
VA, followed by Dunnet’s test. **p<0.01 compared to vehicle-treated control animals 
(data are from [63]) 
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Fig. 5 Effect of SB-269970 microinjected into the dorsal raphe nucleus on sleep and wa¬ 
king. Nine animals were in each experimental group. Ordinate: Mean time spent in sleep 
and waking (min ± s.e.m./2 h). Abscissa: Time after injection (h). The amounts of sleep 
and waking were calculated in 2-h time blocks. Compared with control values: *p<0.05; 
**p<0.01 (Dunnet’s test). Local administration of SB-269970 into the DRN selectively 
suppressed REM sleep (data shown are from [65]) 


Non-DRN 5-HT 7 receptors and REM sleep 

The in vivo effects of systemically administered 5-HT 7 receptor antagonists on 
REM sleep appear consistent with an attenuation of GABAergic inhibitory 
tone in the DRN leading to disinhibition of 5-HT neurons. This, in turn, leads 
to modulation of the activity of those downstream neuronal pathways to which 
the 5-HT neurons project and which control the onset, duration and intensity 
of REM sleep. However, it is possible that 5-HT 7 receptors localized in other 
brain regions known to be implicated in REM sleep control might also play 
a role in mediating the effects of systemically administered 5-HT 7 receptor an¬ 
tagonists on REM sleep. For example, the evidence that REM sleep propensity 
is dependent on circadian phase [66] and that 5-HT 7 receptors play a role in the 
modulation of SCN function, could suggest that the 5-HT 7 receptor modulates 
REM sleep via altering circadian timing. 
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Therapeutic potential of 5-HT 7 receptor ligands in sleep 
and sleep-related disorders 


To date, there have been no clinical studies to investigate the therapeutic poten¬ 
tial of selective 5-HT 7 receptor ligands. However, based on the pre-clinical find¬ 
ings, it is tempting to speculate that these ligands might treat circadian rhythm 
disorders resulting from a dysfunction of the circadian timing system such as 
advanced or delayed sleep phase syndrome (ASPS, DSPS) and delayed or ir¬ 
regular sleep-wake pattern [67], Similarly, based on the data described, selective 
5-HT 7 receptor ligands might show therapeutic utility in sleep disorders, espe¬ 
cially where disrupted REM sleep is a feature. 

Importantly, 5-HT 7 receptor ligands might also show therapeutic utility in 
affective disorders such as unipolar depression in which disrupted sleep pat¬ 
terns are a key feature. Various sleep abnormalities have been observed in de¬ 
pression, including reduced sleep efficiency, reduced sleep time and in particu¬ 
lar, a decreased REM sleep latency combined with an increase in the amount 
of REM sleep [68], The effect of 5-HT 7 receptor antagonists to increase REM 
sleep latency and reduce REM sleep is qualitatively similar to that seen for 
many antidepressants, particularly the selective serotonin-reuptake inhibitors 
(SSRIs). Furthermore, it has recently been reported that SB-269970 can po¬ 
tentiate the increase in REM sleep latency and decrease the amount of REM 
sleep following administration of the SSRI, citalopram, in rats [69], However, 
one caveat in relation to these studies is that not all antidepressants produce the 
same qualitative changes in REM sleep [68] and, therefore, it is unclear whether 
modulation of REM sleep by antidepressant agents is relevant to their clinical 
efficacy in unipolar depression. 

Despite this caveat, additional evidence for a role for the 5-HT 7 receptor 
in unipolar depression has been forthcoming from a number of other (non¬ 
sleep-related) studies. Firstly, chronic administration of a range of antidepres¬ 
sants has been reported to down-regulate 5-HT 7 receptors in rat hypothalamus 
[70-72], Secondly, a number of selective 5-HT 7 receptor antagonists have been 
reported to be active in putative animal models of depression. In particular, it 
has been suggested that SB-269970 is active in both the forced swim and tail 
suspension tests in mice [64, 73], Furthermore, SB-258719 exhibits efficacy in 
the mouse forced swim test [51]. Intriguingly, this antagonist was only active 
when tested in the dark phase, suggesting that 5-HT 7 receptor function may 
vary with circadian phase. Additionally, recent studies suggest that SB-269770 
can potentiate the effect of SSRIs, in rodent depression models [69, 74], Data 
from 5-HT/- knockout mouse studies appear consistent with these pharma¬ 
cological findings, in that the mice show an anti-depressant-like phenotype in 
both the forced swim test and tail suspension tests [64], 
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In summary, although selective 5-HT 7 receptor antagonists have not been 
evaluated clinically, the available preclinical evidence suggest that 5-HT 7 recep¬ 
tors may play a role in the control of circadian rhythms, sleep and unipolar de¬ 
pression. This, in turn, raises the possibility that 5-HT 7 receptor ligands might 
show therapeutic utility in mood disorders. 


Summary and future studies 

The 5-HT 7 receptor has been shown to be widely localized and functional in 
many higher brain areas, including those involved in the control of sleep. Phar¬ 
macological studies both in vitro and in vivo, aided by the availability of selec¬ 
tive 5-HT 7 receptor antagonists, suggest a role for this receptor in a number of 
physiological processes including, sleep, circadian rhythms and mood. Further¬ 
more, preclinical data support a potential role for the receptor in the etiology 
of mood disorders. Although the preclinical studies have greatly increased our 
understanding of the biological role of the receptor, there is currently a lack of 
supportive clinical data due to the difficulty in identifying suitable antagonists 
for clinical investigation. It follows that the identification of such agents will 
help determine the role of 5-HT 7 receptor in CNS disease. 
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Abstract 

Sleep studies in knockout mice have investigated the effects on sleep and wakefulness of 
targeted disruption of genes controlling various proteins involved in serotonergic neuro¬ 
transmission, particulary proteins that regulate serotonin (5-hydroxytryptamine, 5-HT) 
concentration in the extracellular space: the serotonin transporter (5-HTT) and catabo- 
lytic enzyme, monoamine oxidase A (MAOA), as well as serotonergic receptors such as the 
5-HT 1A , 5-HT 1b , 5-HT 2A , 5-HT 2C and 5-HT, sub-types. Mutant mice that do not express 
the 5-HTT, 5-HT 1A or 5-HT 1B receptors exhibit larger amounts of rapid eye movement 
(REM) sleep than their wild-type counterparts. In the case of 5-HT 1A -/- and 5-HT 1B -/- 
mice, the sleep phenotype is mimicked by pharmacological blockade of 5-HT 1A and 5- 
HT 1B receptors, respectively. This indicates that no major compensatory mechanisms have 
developed in these mutants, and that REM sleep is under tonic inhibitory control of se¬ 
rotonin via these receptors, and particularly the 5-HT 1A sub-type. In contrast, pharmaco¬ 
logical blockade of the 5-HTT in wild-type mice has effects on REM sleep opposite to 
those of the transporter gene deletion. In the same manner, ablation of the monoamine 
oxidase A (MAOA) gene results in no major impairment of sleep, whereas pharmaco¬ 
logical inhibition of MAOA induces dramatic REM sleep decrease. These opposite effects 
might be related to the desensitization of 5-HT 1B receptors in 5-HTT-/-, and of 5-HT 1A 
receptors in MAOA-/- mutants, but it seems essentially accounted for by the lack of clear¬ 
ance of serotonin from the extracellular space during early life. Indeed, protection of the 
brain from this serotonin overload during early life (by treatment with an inhibitor of 
serotonin synthesis or with a 5-HT 1A -/- receptor antagonist) rescues a lasting wild-type 
phenotype in 5-HTT-/- mice. In contrast to the previous mutants, 5-HT 7 -/- mice exhibit 
reduced amounts of REM sleep, a profile identical to that obtained in rats after phar- 
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macological blockade of 5-HT, receptors. This indicates that the latter receptor type me¬ 
diate a serotonergic facilitation of REM sleep. Finally, non-REM (NREM) sleep is af¬ 
fected after mutations involving 5-FIT 2 receptors. Both 5-HT 2A -/- and 5-HT 2C -/- mutants 
exhibit reduced NREM sleep amounts compared to wild-type mice, and no change of 
REM sleep. However, pharmacological inactivation of each receptor type induces an effect 
opposite to the genetic invalidation, i.e., enhancement or no change of NREM sleep, and 
pronounced inhibition of REM sleep. Investigations of the response to sleep deprivation, 
total or REM selective, and to immobilization stress indicate that mutants have lost their 
homeostatic sleep properties, except for 5-HT 2C -/- mice that exhibit enhanced rebound of 
cortical slow wave activity after sleep deprivation. In all constitutive mutants examined 
with pharmacological tools, sleep regulations reflect adaptations at serotonergic proteins 
other than the one involved in the mutation. These adaptive processes might participate 
in the sleep phenotype in addition to the mutation itself. To dissect more precisely the role 
of serotonin components in sleep regulations, the data obtained from constitutive mutant 
mice need to be complemented using the new molecular tools such as inducible knockout 
and lentiviral technology. Altogether, the studies performed to date have demonstrated 
the complex role of serotonin in sleep-wakefulness regulations, particularly when taking 
into account the developmental components. In that sense, constitutive mutants might be 
interesting to help define “critical” developmental periods related to vulnerability to sleep 
disorders that probably parallel emotional impairments. 


Introduction 

Over several decades, the influence of serotonin in the regulation of sleep and 
wakefulness have been characterized through studies of lesions and pharma¬ 
cological effects [1], The study of mice with null mutations in the serotonergic 
system has brought new insights into the role of various components of the 
serotonergic neurotransmission in sleep regulations. 

Compared to the pharmacological approach, the targeted disruption of 
genes provides a powerful tool for examining the specific role of a given protein 
in sleep control. However, the constitutive knockout approach has to take into 
account the compensatory processes (up- or down-regulation of gene products) 
that most probably develop when the genes are deleted early in life. 

To date, sleep studies in knockout mice have investigated the effects of ge¬ 
netic impairment at different levels of serotonergic neurotransmission: (1) abo¬ 
lition of serotonin (5-hydroxytryptamine, 5-HT) reuptake or catabolism, which 
induces enhanced availability of 5-HT in the extracellular space, i.e., in mu¬ 
tant mice that do not express the serotonin transporter or monoamine oxidase 
A (MAOA), (2) lack of expression of serotonergic receptors such as the 5-HT 1A 
and 5-HT 1B types, which are heteroreceptors but also autoreceptors located 
on serotonergic neurons, and trigger negative feedback on serotonergic neuro¬ 
transmission; and (3) lack of expression of 5-HT 2A , 5-HT 2C and 5-HT 7 receptor 
types, which are heteroreceptors. 
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Altogether, these studies demonstrate a 5-HT 1A and 5-HT 1B receptor-me¬ 
diated inhibitory, and 5-HT 7 -mediated facilitatory influence of 5-HT on the 
expression of rapid eye movement (REM) sleep, as well as a 5-HT 2 receptor- 
mediated facilitation of non-REM (NREM) sleep. In addition, they show, for 
the first time, an involvement of specific proteins of the serotonergic system in 
sleep properties such as homeostasis and stress-induced response. 


Sleep-wakefulness regulations in knockout mice - 
comparison with pharmacological inactivation of the protein 


Mutant mice that do not express the 5-HT transporter [2, 3] 

The serotonin transporter is located selectively in the membrane of serotonergic 
neurons, at somatic, dendritic and terminal levels, where it drives active reup¬ 
take of released 5-HT into the neuron. Due to lack of this protein, serotonin 
transporter mutant (5-HTT-/-) mice exhibit eightfold higher levels of serotonin 
in the extracellular milieu than their wild-type counterparts [4], and the spon¬ 
taneous firing rate of neurons in the dorsal raphe nucleus (DRN) is decreased 
by 25-50% [5], 

5-HTT-/- mutant mice express normal circadian rhythms of sleep and wake¬ 
fulness, but enhanced amounts of REM sleep (+40% to +50%) compared to 
wild-type mice (Fig. 1). This is observed in both the C57BL/6 [2] and CD1 [3] 
background (Fig. 2), and in both males and females as examined in the CD1 
strain. These REM sleep alterations are evidenced during the light (Fig. 3a) 
and the dark period (Fig. 1), and are due to more frequent occurrence of REM 
sleep bouts (+30% to +80%, respectively) with more bouts of average and long 
duration (0.5-3 min versus 10 s) in the C57BL/6 mutant strain [2], 

Some alterations in the dynamics of the EEG power changes that precede 
REM periods are also found in 5-HTT-/- mutants. In particular, the power 
surge, an increase in both 6-9 Hz and 10-16 Hz EEG power during this transi¬ 
tion phase, is of larger magnitude in mutant than in wild-type mice [2], Finally, 
NREM sleep is not modified in mutants (Figs 1, 2), while wakefulness amounts 
are reduced by about 8-17% [2, 3], In 5-HTT-/- mice of the CD1 strain, NREM 
sleep episodes are shorter (-30%) and more frequent (+35%) than in wild-type 
mice, suggesting that mutants fail to produce sustained wakefulness [3], 

In contrast to genetic inactivation, pharmacological blockade of the trans¬ 
porter in wild-type mice, by treatment with the selective serotonin reuptake in¬ 
hibitor (SSRI) citalopram (1-10 mg/kg i.p.), induces a dose-dependent decrease 
of REM sleep amounts over 2-4 h (Fig. 3b); this effect was mediated mostly by 
5-HT 1A receptors [6], Such REM sleep inhibition after SSRI treatment is a well- 
known phenomenon that has been observed in all species studied [1], 
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Fig. 1 Sleep wakefulness (W) states across the light/dark cycle in male wild type (WT) 
(filled squares) and 5-HTT-/- (open circles) mice. Data (mean ± s.e.m.) are expressed as 
min/3 h. # p<0.05 significantly different from wild-type mice, Student’s t-test. Adapted 
from [3] 


Thus, spontaneous expression of sleep and wakefulness in 5-HTT-/- mutants 
does not mimic the effects of acute inactivation of the serotonin transporter 
(Table 1). This discrepancy might be explained, at least in part, by desensitiza¬ 
tion of 5-HT 1A and 5-HT 1B receptors in 5-HTT-/- mutants [3-5, 7], as discussed 
below (see: Compensatory mechanisms in constitutive knockouts: pharmacologi¬ 
cal challenges). 


Mutant mice that do not express MAO [8, 9| 

MAOA is the main catabolytic enzyme of serotonin, and is found in mitochon¬ 
dria. Its lack in mutant mice (MAOA-/-) results in tonic enhancement of sero¬ 
tonin content in brain tissue (1.5-2-fold increase compared to wild-type mice) 
[10] as well as in the extracellular space (2-3-fold) [11], In parallel, electrophysi- 
ological activity of serotonergic neurons in the DRN is tonically decreased by 
about 40% [11], 

MAOA-/- mice express light entrained circadian rhythms of sleep and wake¬ 
fulness similar to those in animals of the reference strain (C3H line), but de¬ 
creased quantities of REM sleep (-30%) during the dark period [8], No differ¬ 
ences in the amounts of sleep and wakefulness are observed during the light 
period [8, 9], Interestingly, MAOA-/- mice exhibit a 3-fold larger number of ap¬ 
neas during sleep than wild-type mice, an effect that is antagonized by treatment 
with the serotonin synthesis inhibitor para-chlorophenylalanine (pCPA) [9], 

Pharmacological inactivation of MAO by clorgyline (10 mg/kg i.p.) during 
the light period in wild-type, but not in transgenic, mice induces an inhibition 
of REM sleep and an increase in the number of sleep apneas [9], Such REM 
sleep inhibition has been observed previously in other species [1], 

Thus, the effects of deletion of the MAOA-encoding gene on sleep organi¬ 
zation contrast with those of pharmacological inhibition of the enzyme with 
regard to REM sleep (at least during the light period) (Tab. 1), but mimic those 
on sleep apneas. 
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Fig. 2 Effect of various mutations on the amounts of NREM and REM sleep. Data 
(mean ± s.e.m.) are calculated over 24 h, and expressed as percent of wild-type counter¬ 
parts. # p<0.05 significantly different from respective wild-type mice, Student’s t-test 


Mutant mice that do not express 5-HT 1A or 5-HT 1B receptors [12, 13[ 

Receptors of the 5-HT 1A and 5-HT 1B types are located [14]: (1) in serotoner¬ 
gic neurons themselves where, as autoreceptors, they mediate a 5-HT-triggered 
negative feedback on the firing of serotonergic neurons and on the release of 
5-HT, respectively; and (2) on non-serotonergic neurons where, as post-synap- 
tic or heteroreceptors, they inhibit the latter neurons. Heteroreceptors of the 
5-HT 1B type modulate negatively the release of other neurotransmitters such 
as GABA [15, 16] and acetylcholine [17]. 5-HT 1A receptors are found in higher 
density in the raphe nuclei (autoreceptors), hippocampus, entorhinal cortex 
and lateral septum [18], while 5-HT 1B receptors are distributed mostly in ventral 
pallidum, globus pallidus, substantia nigra and dorsal subiculum [19]. 

Baseline 5-HT concentrations do not differ between 5-HT 1A -/- mutant and 
wild-type mice, supporting the fact that 5-HT 1A receptors do not control 5-HT 
release ([20, 21] but see [22]). Surprisingly, 5-HT levels are unchanged also in 5- 
HT 1B -/- mutants, but autoregulation at serotonergic nerve terminals is dramati¬ 
cally impaired or no longer efficient in these mutants [23, 24], 

Sleep in 5-HT 1A -/- and 5-HT 1B -/- mutants has been studied in the 129/Sv 
mouse strain [12, 13], Neither mutation affects the light-entrained circadian 
rhythm of sleep and wakefulness. However, the amounts of REM sleep are 





462 


Joelle Adrien 


§ b 

M Citalopram 


\k. 


S-HTja 5-HT 1b 

Gene deletion 


MM; 


Acute pharmacological blockade 

WAY 100635 GR 125939 


III 


r-L, 

m 


Fig. 3 Effect on REM sleep of gene deletion (a) and pharmacological blockade (b) of 
the serotonin transporter (left), 5-HT 1A (middle) and 5-HT 1B (right) receptors. REM 
sleep amounts (mean ± s.e.m.) are expressed in min/2 h: top: in wild-type (empty bars) 
and knockout (filled bars) mice, and bottom: after injection of saline (empty bars) or the 
compounds (filled bars) in wild-type mice. The SSRI citalopram (1 mg/kg), the 5-HT 1A 
antagonist WAY 100635 (1 mg/kg) and 5-HT 1B antagonist GR 126935 (1 mg/kg) were 
injected i.p. at 10:00, and sleep-wakefulness were monitored from 10:00 until 18:00. * 
p<0.05: significantly different from respective wild-type mice, Student’s t-test. * p<0.05: 
significantly different from injection of saline, paired Student’s t-test. Adapted from [3, 
6 , 8 , 12 ] 


enhanced in 5-HT 1A -/- mutants (+41%) (Fig. 2) during essentially the light 
(Fig. 3a) but also the dark period, and in 5-HT 1B -/- mice (+24%) during only 
the light period (Fig. 3a). In 5-HT 1A -/- mutants, these modifications are ac¬ 
counted for by an increase of the mean duration of paradoxical sleep bouts 
during the light period (1.25±0.04 vs 1.08±0.02 min), and an increase in their 
number during the dark one (35.6±2.5 vs 26.8±2.5 min). 

Slow wave sleep (SWS) amounts are unchanged in 5-HT 1A -/-, and slightly re¬ 
duced (-6%) (Fig. 2) during the light period in 5-HT 1B -/- mutants, while wake¬ 
fulness is not modified. 

Acute pharmacological blockade of either 5-HT 1A (with WAY 100635) or 
5-HT 1B (with GR 125939) receptors in wild-type mice has been examined to see 
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whether this mimicked the effect of genetic ablation of these receptors [12, 13], 
REM sleep is enhanced over 4 h by both antagonists notably at the doses of 
1 mg/kg i.p. (+61 and +36%, respectively, Fig. 3b). Conversely, activation of ei¬ 
ther receptor by selective agonists such as 8-hydroxy-2-di-n-propylamino-tetra- 
lin (8-OH-DPAT, 0.2-1.2 mg/kg s.c. ) and RU 24969 (0.25-3 mg/kg i.p.) or CP 
94253 (1-10 mg/kg i.p.), respectively, induces in wild-type mice a dose-depen¬ 
dent inhibition of REM sleep 2-4 h post-injection [12, 13]. The other states of 
vigilance are essentially not affected by these compounds, at least at moderate 
doses. These effects are in agreement with those described in other species [1], 
Thus, both ablation of the 5-HT 1A or 5-HT 1B receptor gene in mutants and 
pharmacological blockade of 5-HT 1A or 5-HT 1B receptors in wild-type mice 
induce enhanced expression of REM sleep (Tab. 1). These data confirm and 
extend previous results [1] and indicate that REM sleep expression is under 
tonic inhibitory control of serotonin via these receptors, primarily the 5-HT 1A 
type [6], Because these receptors are autoreceptors (mediating a negative feed¬ 
back triggered by serotonin) and heteroreceptors, the question remains open 
as to which type of receptor (auto- or hetero-) is primarily involved in REM 
sleep regulation by 5-HT. A number of arguments support the post-synaptic 
hypothesis [25], notably at brainstem targets [26, 27], but further investigations 
are needed to answer this question more precisely. 


Mutant mice that do not express 5-HT 2A [28] or 5-HT 2C [29] receptors 

5-HT 2A and 5-HT 2C receptors are distributed mostly in the cerebral cortex, ol¬ 
factory system, septum, hippocampus, basal ganglia, amygdale, diencephalon, 
cerebellum, brainstem and spinal cord [30, 31]. 

Both 5-HT 2A -/- (of the 129Sv/Ev Tac background) and 5-HT 2C -/- (of the 
C57BL/6 background) mice exhibit enhanced amounts of wakefulness (+50 
and +20%, respectively), associated with an increase in the duration of indi¬ 
vidual waking bouts (+40% and +30%, respectively). In parallel, NREM sleep 
is decreased (-30%) (Figs 2, 4a), with shorter duration of episodes (3.1 ±0.2 vs 
3.6±0.2 min) in 5-HT 2A -/- [28] and reduced number of transitions from NREM 
to REM sleep in 5-HT 2C -/- [29] mice. REM sleep is globally unchanged in mu¬ 
tants, except for its reduced latency and enhanced frequency of theta rhythm 
[28], which may reflect an increased “pressure” of REM sleep similar to that 
observed in relation with depression [32], 

Pharmacological studies using selective 5-HT 2 receptor ligands in rats and 
humans [33] have suggested that the latter receptors may be involved in the 
regulation of NREM sleep and in the timing of the NREM-REM sleep cycle 
[34], In wild-type mice, the effects of pharmacological activation of 5-HT 2 re¬ 
ceptors depend on which subtype is concerned. Selective antagonist at 5-HT 2A 
receptors (MDL 100907 at a dose of 2 and 5 mg/kg i.p.) induces over 3 h an 
increase of NREM sleep amounts (+80 and +85%, respectively) concomitant 
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Fig. 4 Effect on slow wave sleep (SWS) and REM sleep of gene deletion (a) and pharma¬ 
cological blockade (b) of 5-HT 2A receptors. Sleep amounts (mean ± s.e.m.) are expressed 
in min/2 h. Top: in wild-type (empty bars) and 5-HT 2A -/- (filled bars) mice, and bottom: 
after injection of saline (empty bars) or the 5-HT 2A receptor antagonist MDL 100907 
(2 mg/kg i.p., filled bars) in wild-type mice. * p<0.05: significantly different from respec¬ 
tive wild-type mice. Student’s t test. * p<0.05: significantly different from injection of 
saline, paired Student’s t test. Adapted from [28] 


with a decrease of wakefulness (-54 and -66%) and REM sleep (-76 and -83%) 
time (Fig. 4b). In contrast, 5-HT 2C receptor antagonist (SB242084, 0.5-2.5 mg/ 
kg i.p.) provokes no significant change of NREM sleep or wakefulness, and a 
decrease of REM sleep amounts (-50%) during 3 h post-injection, but only 
at the lowest doses [28], The latter effect, which is not observed for the dose 
of 2.5 mg/kg, might be indirect and depend on the catecholaminergic systems 
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since 5-HT 2C receptors tonically inhibit the latter neurotransmissions [35], 
Therefore, 5-HT 2C antagonist might enhance the noradrenergic REM-off tone, 
and in turn decrease REM sleep. 

To conclude, pharmacological inactivation of 5-HT 2A and 5-HT 2C receptors 
produces effects on sleep that oppose the phenotypes observed after genetic in¬ 
validation of these receptors (Tab. 1). Such discrepancy might be explained, at 
least in part, by reciprocal adaptations of these systems in constitutive mutants 
(see Compensatory mechanisms in constitutive knockouts: pharmacological chal¬ 
lenges below). 


Mutant mice that do not express 5-HT 7 receptors [36] 

Receptors of the 5-HT 7 type are distributed mostly in the hypothalamus (nota¬ 
bly in the suprachiasmatic nuclei), thalamus, hippocampus and frontal cortex 
[37, 38], Their inactivation produces the same behavioral effects as those of 
SSRIs, possibly due to their ability to modulate the reuptake of serotonin [36, 
39], 

Mice of the 5-HT 7 -/- phenotype (backcrossed on the C57BL/6J back¬ 
ground) show a normal circadian sleep pattern, but spend less time in REM 
sleep (-16%) than their wild-type counterparts (Fig. 2), essentially during the 
light period [36], This decrease in REM sleep amounts is accounted for by a 
decrease in the number of REM sleep bouts (45.7±1.6 vs 65.9±3.8 per 24 h), 
despite an increase in their mean duration (1.44±0.05 vs 1.19±0.06 min). In 
contrast to REM sleep, the characteristics of wakefulness and SWS are not dif¬ 
ferent between the two genotypes. 

The effects of 5-HT 7 antagonists on sleep and wakefulness in mice have not 
been examined. In rats, pharmacological blockade of these receptors induce a 
decrease of REM sleep amounts [40,41], 

Therefore, the sleep modifications observed in 5-HT 7 -/- mutants are similar 
to those after pharmacological blockade of 5-HT 7 receptors (Tab. 1). This sug¬ 
gests that the latter receptors would mediate a facilitatory role of serotonin on 
REM sleep. 


Homeostasis and sleep 

Sleep deprivation is known to induce in wild-type mice an enhancement of 
slow wave activity (SWA) [42], assessed by the EEG power density in the delta 
frequency range, a marker of sleep homeostasis [43], 

The effects of a sleep deprivation challenge have been examined only in 
the case of 5-HT 2 receptor mutations. The post-deprivation increase of SWA 
is not observed in 5-HT 2A -/- mutants (of the 129SvEV strain), which exhibit 
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only a slight increase in the mean duration of NREM sleep bouts (3.1 ±0.3 vs 
2.6±0.2 min at baseline) [28], In contrast, in 5-HT 2C -/- mutants, sleep depriva¬ 
tion induces during the first 6 hours of the recovery period an enhancement 
of SWA (+37%) as well as of NREM sleep amounts (+22%) and mean bout 
duration (6.3±0.6 vs 3.5±0.2 min at baseline) [29], Both effects are larger than 
those in wild-type mice that exhibit during the same recovery period only a 
15% enhancement of SWA and no change in NREM sleep characteristics [29], 
Altogether, these data indicate that 5-HT 2A and 5-HT 2C receptor subtypes are 
differentially involved in sleep homeostasis, with regard to SWA and to sleep 
fragmentation. 

REM sleep processes undergo homeostatic regulations that are observed 
under conditions of selective REM sleep deprivation. These processes are illus¬ 
trated, during the recovery period, by changes in EEG power at the transition 
between NREM and REM sleep [2, 44], and by increased amounts of REM 
sleep: the REM sleep rebound [45, 46], 

Among mutant strains that have been selectively deprived of REM sleep, 
5-HTT-/- mutant mice exhibit during the recovery period an enhancement of 
the 10-16 Hz EEG frequency power at transitions from NREM to REM sleep, 
suggesting that REM sleep homeostasis could be impaired in these mutants 
[2], With regard to the REM sleep rebound, while it is observed during the 
first 3-6 h of the recovery period (+75 or +50% of baseline value, depending 
whether the recovery period begins at light-on or light-off, respectively ) in mice 
of the 129 Sv/Ev background [12], it is abolished in 5-HT 1A or 5-HT 1B mutants 
[12, 13], This indicates that functional 5-HT 1A or 5-HT 1B receptors are required 
for REM sleep homeostatic processes to occur. 


Stress and sleep 

It has been shown in rats that acute stress (such as immobilization) triggers 
a REM sleep rebound that is linked to serotonergic activation and can be con¬ 
sidered as an adaptive mechanism [47], 

In wild-type mice, an immobilization challenge of 60-90-min duration is fol¬ 
lowed by enhancement of REM sleep amounts that begins 3-6 h after the end 
of stress and lasts for 6-18 h afterwards. This increase ranges around +30 and 
+80% of baseline values, depending on the strain [13,48-50], in agreement with 
previous results obtained in rats [47], Interestingly, the REM sleep rebound af¬ 
ter immobilization stress is abolished in 5-HTT-/- [49, 51], MAOA-/- (Boutrel, 
unpublished data), 5-HT 1A -/- [13] and 5-HT 1B -/- (Boutrel, unpublished data) 
mutants, suggesting that the REM sleep-adaptive response to acute stress de¬ 
pends on the integrity of serotonergic neurotransmission. 
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Compensatory mechanisms in constitutive knockouts: 
pharmacological challenges 


As indicated above, the frequently observed opposite effects of gene deletion 
versus acute pharmacological inactivation of the same protein suggest that 
compensatory phenomena have occurred in constitutive mutants. Such plastic¬ 
ity has been unveiled by means of pharmacological challenges aimed at sero¬ 
tonergic proteins other than those involved in genetic deletion, or at non-sero- 
tonergic systems. However, to which extent these compensatory mechanisms 
contribute to the altered expression of sleep at baseline in constitutive mutant 
mice remains an open question. 


Adaptive processes at serotonergic neurotransmission 

In 5-HTT-/- mutants, activation of 5-HT 1A receptors by 8-OH-DPAT induces 
the same inhibition of REM sleep as in wild-type mice, and no change in SWS 
or wakefulness. In contrast, activation of 5-HT 1B receptors by CP 94253 has no 
effect on either vigilance state in mutants, whereas it reduces REM sleep and 
enhances SWS in wild-type mice [52], Therefore, sleep regulations in 5-HTT-/- 
mutants reflect unchanged 5-HT 1A and decreased 5-HT 1B influence over REM 
sleep. These adaptive phenomena do not always fit with other approaches of 
5-HT 1A and 5-HT 1B receptor-related functions. For example, they are in sharp 
contrast to binding studies that report desensitization of 5-HT 1A receptor in the 
DRN, laterodorsal tegmental nucleus (LDT), but increased protein levels in the 
hypothalamus [3-5, 7], However, with regard to 5-HT 1B receptors, results from 
other studies are in agreement with sleep data, since reduced density of these 
receptor type associated with dramatic functional desensitization is found in 
5-HT-/- mice [4], 

Sleep expression at baseline in 5-HTT-/- mutants is coherent with these adap¬ 
tive phenomena. Indeed, blunted 5-HT 1B -/- receptor-mediated sleep response 
may contribute to the increased REM sleep expression, since it corresponds 
to a reduction of the serotonergic “REM-off” tone, an influence that would 
facilitate REM sleep. 

In MAOA-/- mutants, the inhibition of REMS by 8-OH-DPAT is smaller, 
and by the SSRI citalopram is larger, than in wild-type mice [8], suggesting 
desensitization of 5-HT 1A receptors and increased efficiency of the serotonin 
transporter. This is in agreement with electrophysiological data that show that 
serotonergic neurons in the DRN of MAOA-/- mice are largely unresponsive 
to 5-HT 1A receptor activation by 8-OH-DPAT, but it opposes the fact that these 
neurons are less inhibited by citalopram than those in wild-type mice [11], 

These adaptive phenomena at serotonergic receptor and transporter appear 
to almost fully compensate for the dramatic enhancement of 5-HT concentra¬ 
tion in the extracellular milieu, since no major modifications of sleep are ob¬ 
served in these mutants at baseline. 
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In 5-HT 1A -/- and 5-HT 1B -/- mutants, adaptive phenomena occur at 5-HT 1B 
and 5-HT 1A receptors, respectively. Indeed, the former mutant mice exhibit a 
significantly greater REM sleep-inhibitory response than wild-type mice on 
injection of the 5-HT 1B agonist CP 94253 [13], in parallel to an enhanced sen¬ 
sitivity of 5-HT 1B receptors (in the striatum) [53], In the same manner, 5-HT 1A 
receptor-triggered sleep alterations are augmented in 5-HT 1B -/- mutant com¬ 
pared to wild-type mice, suggesting hypersensitivity of 5-HT 1A receptors in 
these mutants. However, other studies suggest rather desensitization of 5-HT 1A 
receptors in 5-HT 1B -/- mice [54] and down-regulation of the 5-HT transporter 
in 5-HT 1A -/- mutants [55], These discrepancies might be due to the fact that re¬ 
ceptor adaptations in mutant mice are different in various brain areas [54] and 
that these areas regulate different functions. 

These adaptive phenomena would tend to induce a decrease instead of an 
increase of REM sleep expression. Thus, in 5-HT 1A -/- and 5-HT 1B -/- mutants, 
hypersensitivity of the complementary receptor, i.e., 5-HT 1B and 5-HT 1A sub- 
types, respectively, cannot account for the enhancement of REM sleep. On the 
contrary, since both receptor types mediate an inhibitory influence of serotonin 
on REM sleep processes, their hypersensitivity would tend to limit the enhance¬ 
ment of REM sleep in these mutants. 

Examination of sleep in double 5-HT 1A/1B -/- mutant mice should allow as¬ 
sessment of how these compensatory mechanisms contribute to the expression 
of REM sleep in each of the 5-HT 1A -/- and 5-HT 1B -/- mutant strains. 

In 5-HT 2A -/- mice, activation or blockade of 5-HT 2B receptors induce atten¬ 
uated effects on NREM sleep (no effect or a decrease, respectively) compared 
to those in wild-type controls [28], In contrast, blockade of 5-HT 2C receptors 
induced a larger inhibition of REM sleep in these mutants than in wild-type 
mice. Thus, with regard to sleep regulations, genetic deletion of 5-HT 2A recep¬ 
tors leads to hyposensitivity of 5-HT 2B and hypersensitivity of 5-HT 2C receptors. 
The reduced sensitivity of 5-HT 2B receptors could account, at least in part, for 
the paradoxical decreased expression of NREM sleep at baseline in 5-HT 2A -/- 
mutants, since these receptors mediate a facilitatory influence of 5-HT on this 
sleep state [28], 

Finally, in 5-HT 7 -/- mutants, the SSRI citalopram increases REM sleep 
latency more in mutants than in wild-type mice [36], This different effect in 
mutants could be due not only to the lack of 5-HT 7 receptors, but also to en¬ 
hanced sensitivity of 5-HT 1A receptors [6], Analysis of the effects of selective 
5-HT 1A ligands in these mutants should allow answering this question. 


Adaptive processes at other neurotransmissions 

Adaptive phenomena are also observed at systems other than the serotonergic 
one, and might impinge upon sleep-wakefulness regulations. For example, sen¬ 
sitivity of adenosine receptors is modified in 5-HTT-/- and MAOA-/- mutants. 
Adenosine A, receptors are found in higher density (in the DRN: +21%) in 
5-HTT-/- than in wild-type mice and unchanged in MAOA-/- mutants, whereas 
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A 2A receptor density is decreased in 5-HTT-/- (in the nucleus accumbens: -27%) 
and enhanced in MAOA-/- (in the caudate: +28%, and accumbens: +23%) mice 
[56], In 5-HTT-/- mutants, since A 1 receptors mediate an inhibitory effect on 
hypocretinergic neurotransmission [57], their up-regulation would facilitate 
REM sleep, which is the case in these mutant mice. In contrast, desensitization 
of A 2A receptors, if it occurs in sleep-related structures, would result in reduced 
expression of REM sleep [58], which opposes the sleep phenotype expressed by 
5-HTT-/- mice. 

Other examples are found in 5-HT 1A -/- and in 5-HT 1B -/- mice, in which the 
dopamine turnover is increased [59], and in 5-HT 1A -/- mutants that exhibit de¬ 
sensitization of GABA-A receptors in the amygdala and hippocampus, associa¬ 
ted with a smaller response than that in wild-type controls to the anxiolytic and 
sedative effects of benzodiazepines [60], The sleep sensitivity of these mutants 
to other hypnotics has not been investigated yet. 


Critical periods of development for the setting 
up of the sleep phenotype 


The sleep-wakefulness alterations observed in constitutive mutants may result 
schematically from the absence of the gene-invalidated protein during develop¬ 
ment, or from its chronic deficiency in the adult. The opposite effects of gene in¬ 
validation and acute pharmacological functional alteration found in 5-HTT-/-, 
MAOA-/- and 5-HT 2 -/- mutant mice, support the developmental hypothesis. 
The question can be asked of when, during development, these adaptations 
take place. 

As far as sleep regulation is concerned, this has been examined in 5-HTT-/- 
mice. In the latter mutants, the lack of 5-HT reuptake results in enhanced levels 
of the amine in the extracellular milieu that, in turn, alters the development of 
brain circuitry [61]. Therefore, it can be proposed that serotonin overload dur¬ 
ing early life impairs the development of central networks that will later control 
sleep-wakefulness patterns throughout life. This hypothesis has been tested by 
inhibiting 5-HT synthesis in 5-HTT-/- mutant pups using pCPA treatment. Such 
treatment (100 mg/kg/day) applied to mutant neonates from days 5 to 20 after 
birth induces rescue of wild-type sleep phenotype, as examined at adulthood 
[3] (Fig. 5). Furthermore, this effect is essentially mediated by 5-HT 1A receptors 
since similar treatment with the selective 5-HT 1A antagonist WAY 100635 also 
induces recovery, but partial, of wild-type REM sleep phenotype in 5-HTT-/- 
mutants (Fig. 5). Most importantly, if the same treatment is applied during the 
second month of life, it does not induce any lasting sleep modifications. 

Thus, abnormalities of sleep patterns in male and female 5-HTT-/- mutant 
mice can be durably reversed by limiting, during early life, the 5-HT 1A receptor- 
mediated action of endogenous 5-HT on the central nervous system, unveiling 
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Fig. 5 Effect on REM sleep of neonatal treatment with compounds reducing 5-HT neu¬ 
rotransmission in 5-HTT-/- mutant mice. REM sleep amounts (mean ± s.e.m.) in adult 
male (left) and female (right) mice are expressed in min/24 h in groups treated neonatally 
with the 5-HT synthesis inhibitor pCPA (100 mg/kg/day from post-natal days 5 to 19) 
or the 5-HT 1A receptor antagonist WAY 100635 (1 mg/kg/day from age 4 to 32 days). 
Control animals of each genotype (empty bars) received saline for 2 or 4 weeks under 
the same conditions. * p<0.05: significantly different from respective wild-type mice, 
Student’s t test. * p<0.05: significantly different from injection of saline, paired Student’s 
t-test. Adapted from [3] 


the developmental role of serotonin on building up of neuronal networks in¬ 
volved in REM sleep regulation [3], 


Conclusion 

The data obtained from mutant mice with regard to serotonin involvement in 
sleep/wakefulness regulations have confirmed the hypotheses generated from 
the pharmacological approach, but have also brought evidence of novel roles 
of serotonin in these functions. In particular, the knockout approach has dem¬ 
onstrated the opposite influence mediated by 5-HT 2A and 5-HT 2C receptors on 
SWA and NREM sleep homeostasis, as well as the facilitatory role of 5-HT on 
REM sleep rebound that occurs after selective deprivation of this sleep state, or 
after acute stress. These functions could not be studied solely using the phar¬ 
macological tools. 

The diversity of strains used for backcrossing the mutant mice in sleep stu¬ 
dies is an interesting opportunity in terms of the specificity of the resulting 
alterations. Indeed, if the same sleep phenotype is found after deletion of a 
given gene in two different stains of mice, it limits the confounding effect of 
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other sleep-related genes that would be linked to the deleted one. This has been 
performed in the case of 5-HTT-/- mutants (Fig. 2). 

Availability of knockout mice has also opened the way to investigation of 
the developmental period during which a particular sleep phenotype is built-up, 
and has indicated that transient protection of the central nervous system from 
an overload of 5-HT during early life has lasting rescuing effects in the adult. 
In this context, a limited developmental period should be considered as at risk 
for a serotonin-triggered alteration of sleep later in life. Conversely, if a given 
gene organization induces some vulnerability to sleep disorders that should ap¬ 
pear later in life, it might be prevented by treatment during this period. 

Finally, the compensatory mechanisms, even though they render the inter¬ 
pretation of the results difficult because the impairments observed might be 
accounted for by other phenomena than directly the gene deletion, can repre¬ 
sent in themselves a model for studying long-term treatment with serotonergic 
pharmacological compounds. 

Still, the emerging technology of inducible knockouts, or lentiviral vectors 
applied directly into brain structures, will help overcome the difficulty of as¬ 
sessing the part of adaptive processes underlying sleep regulation in constitu¬ 
tive mutants, and the neuronal networks involved. For example, using the lat¬ 
ter local approach, issues regarding pre- versus post-synaptic involvement of 
5-HT 1A and 5-HT 1B receptors in sleep regulations [25] could be addressed. 
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Abstract 

This chapter reviews the role of the different serotonin receptors located in the circadian 
apparatus and their possible clinical implications for the activity of antidepressants. The 
central oscillator located in the hypothalamic suprachiasmatic nuclei (SCN) received 
three major inputs: (a) the retinohypothalamic tract, which extends from the retina and 
releases glutamate and pituitary adenylate cyclase-activating polypeptide at its nerve end¬ 
ings; (b) the geniculohypothalamic tract, which originates in the retino-recipient area of 
the intergeniculate leaflet (IGL) and releases neuropeptide Y and y-aminobutyric acid as 
transmitters; (c) a dense serotonergic innervation arising from ascending projections of se¬ 
rotonin neurons in midbrain raphe nuclei. Serotonergic projections come directly from the 
median raphe nucleus and indirectly from the dorsal raphe nucleus via the IGL. Destruc¬ 
tion of serotonergic afferents to the SCN modifies circadian behavioral responses to light. 
At the SCN several serotonin receptors are localized (i.e., 5-HT 1A , 5-HT 1B , 5-HT 2A , 5-HT 2C , 
5-HT 5A and 5-HT, receptor subtypes). Basic and clinical data on the efficacy of agomela- 
tine, a novel antidepressant that combines a potent agonist activity of melatonin MT, and 
MT 2 receptors and an antagonist activity of 5-HT 2C receptors, are reviewed. 
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Introduction 

Circadian rhythms (circa = about; dies = day) are rhythms that are close to 24 h 
in period length and are the most thoroughly explored biological rhythms. The 
medical implications of these rhythms have been recognized recently, circadian 
rhythmicity providing the possibility of anticipating, and therefore preparing 
for events repetitively associated with daily light-dark (L/D) alternation. The 
reliance on the biological clock is so entrenched in life that forced disruptions 
of the natural synchrony between the environment and the internal clock is 
a risk factor for a number of diseases [1-3]. 

Using ablation, transplantation or electrophysiological studies, it has been 
shown that the suprachiasmatic nucleus (SCN) of the hypothalamus acts as the 
main biological clock in animals as well as in human beings [4, 5], In mammals, 
daily rhythms in behavior and physiology are driven by the circadian timing 
system comprising, in a hierarchical way, the master pacemaker in the SCN 
and peripheral oscillators in most body cells. At the molecular level, in both 
the SCN and peripheral oscillators, the circadian clock mechanism is built from 
interconnected feedback loops in gene expression that operate in a cell-autono¬ 
mous and self-sustained fashion [2, 3], 

Circadian rhythms have a free-running period that can be entrained by 
a Zeitgeber (time cue). In the absence of temporal cues like the L/D cycle circa¬ 
dian rhythms free run and can be readjusted to 24 h by light impinging on the 
retina. Human beings have an endogenous free-running period slightly longer 
than 24 h [6], If the circadian pacemaker were not adjusted the timing of en¬ 
dogenous rhythms would lose up to an hour a day with respect to clock time 
of the day. 

Abnormal phase positions and severe disturbances in 24-h sleep/wake 
rhythms have become prominent features of the circadian rhythm sleep dis¬ 
orders (CRSD) [7, 8], These disorders do not respond well to conventional 
methods of treatments such as the use of hypnotics but respond to therapeutic 
manipulations based upon chronobiological principles, such as the use of pho¬ 
totherapy or the administration of chronobiotics, e.g., melatonin or its ana¬ 
logs. 

The major objectives of this chapter are to analyze the role of the different 
serotonin receptors located in the circadian apparatus and their possible clini¬ 
cal implications for the activity of commonly employed antidepressants, and 
to summarize the clinical features of CRSD and their response to agents that 
interact with both the circadian and the serotonergic system, like the melatonin 
analog agomelatine (Valdoxan®, Servier). 


SCN as the central oscillator 

The SCN comprises numerous single-cell oscillators that, when synchronized, 
produce a coordinated circadian output [5], Modification of SCN output (i.e.. 
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firing rate of SCN neurons) ultimately affects physiological and behavioral 
rhythms. The SCN can be entrained by photic cues, i.e., light, and by non-pho- 
tic cues, such as access to a running wheel [9, 10] or food availability [11], 

External information reaches the SCN through three major inputs. The first 
is the retinohypothalamic tract (RHT), which extends from the retina and re¬ 
leases glutamate and pituitary adenylate cyclase-activating polypeptide at its 
nerve endings [12], The second is the geniculohypothalamic tract (GHT), which 
originates in the retino-recipient area of the intergeniculate leaflet (IGL) and 
releases neuropeptide Y (NPY) and y-aminobutyric acid (GABA) as transmit¬ 
ters [12], The third SCN input is a dense serotonergic innervation arising from 
ascending projections of serotonin neurons in midbrain raphe nuclei. Seroto¬ 
nergic projections come directly from the median raphe nucleus and indirectly 
from the dorsal raphe nucleus via the IGL [13-15], Furthermore, a tract con¬ 
necting the retina with the DRN exists in the rat, but not in the hamster [12], 
The terminal fields of retinal, IGL, and serotonergic afferents are coextensive 
in the ventral region of the SCN, suggesting that serotonergic afferents modify 
RHT and/or IGL input to the SCN. Indeed, destruction of serotonergic affer¬ 
ents to the SCN modifies circadian behavioral responses to light [14], 

During the past decade, enormous progress has been made in determining 
the molecular components of the circadian clock. The molecular mechanisms 
that underlie the function of the clock are universally present in all cells and con¬ 
sist of gene-protein-gene feedback loops in which proteins can down-regulate 
their own transcription and stimulate the transcription of other clock proteins 
[2, 3], Although anchored genetically, circadian rhythms are synchronized by 
(entrained) and maintain certain phase relationships to exogenous factors. 

Although the SCN clock is mainly entrained by L/D cycles, the peripheral 
oscillators can be strongly affected by other factors, like daily feeding cycles 
[11], However, when feeding schedules are coupled with a caloric restriction, 
behavioral and physiological circadian rhythms and gene expression in the SCN 
are shifted and/or entrained to mealtime. Indeed, energy metabolism and moti¬ 
vational properties of food can influence the clock mechanism of the SCN. 

An entraining agent can actually reset, or phase shift, the internal clock. De¬ 
pending on when an organism is exposed to such an entraining agent, circadian 
rhythms can be advanced, delayed, or not shifted at all. Therefore, involved in 
adjusting the daily activity pattern to the appropriate time of day is a rhythmic 
variation in the influence of the Zeitgeber as a resetting factor. 


Serotonin and midbrain raphe contribution 
to circadian rhythm regulation 


For a detailed review on this subject see [12], Microdialysis studies in both the 
peri-SCN and peri-IGL regions indicated that extracellular serotonin increases 
sharply after lights off [16, 17], Similarly, extracellular serotonin increases in 
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both the SCN and IGL in response to non-photic stimuli [17]. Serotonin avail¬ 
ability in SCN and IGL is augmented by electrical stimulation of the dorsal 
raphe nucleus [18, 19]. 

A view that was accepted for years was that the dorsal raphe nucleus consti¬ 
tuted the single source of serotonergic innervation of the SCN [13, 14], How¬ 
ever, anatomical studies by anterograde and retrograde tract tracing of raphe 
projections, and lesion studies of raphe projections, have indicated that the me¬ 
dian raphe sends mixed serotonergic and non-serotonergic projections to the 
SCN, while the dorsal raphe sends mixed serotonergic and non-serotonergic 
projections to the IGL [15,20], In hamsters bearing lesions of median raphe se¬ 
rotonin neurons, a larger amplitude response and a greater prevalence of light- 
induced rhythm splitting were observed [21], even in the presence of a normal 
light sensitivity [22, 23], By the contrary, no effects on rhythmicity were seen 
following lesioning of dorsal raphe serotonergic cells. 

Among the 14 serotonin receptor subtypes currently described, several are 
localized at the SCN, including 5-HT 1A , 5-HT 1B , 5-HT 2A , 5-HT 2C , 5-HT 5A and 5- 
HT 7 receptor subtypes [24-32] (Fig. 1). In discussing the effects of the different 
serotonin receptors in circadian regulation, it must be kept in mind that species 
differences are remarkable as far as serotonin circadian influence are concerned. 
These species differences were uncovered in a study monitoring murine and 
hamster responses to a variety of 5-HT agonists [33], For many of the 5-HT 1A , 
5-HT 1B , 5-HT 2 or 5-HT 7 agonists tested changes were observed depending on 
the central or peripheral administration of the drugs. Phase responses to 5-HT 
agonists were markedly depending on prior exposure to light [34], 

5-HT 1A receptors are of special interest in circadian regulation because they 
are localized in several structures that potentially influence rhythms, i.e., inhibi¬ 
tory autoreceptors on dendrites of raphe serotonergic neurons that project to 
the SCN, at the SCN itself and at the IGL, and other structures that control 
circadian rhythmicity [27], Additionally, 5-HT 1A receptors modulate melatonin 
secretion and circadian scheduling of behavior in rats [35], 

Serotonin agonists to 5-HT 1A , 5-HT 1B and 5-HT 7 receptors generally inhibit 
light-induced phase shifts in hamster activity rhythms [32, 36], In contrast, 5- 
HT antagonists to 5-HT 1A , 5-HT 1B and 5-HT 7 receptors generally have no effect 
[12, 32], 

Mainly from an anatomical standpoint, the 5-HT SA receptor is presumably a 
major contributor to circadian rhythm regulation. 5-HT SA receptors are distrib¬ 
uted in the dorsal and median raphe nuclei, as well as in their circadian targets, 
the SCN and the IGL [28], However, it must be noted that 5-HT 1A and 5-HT 7 
exhibit a similar pharmacological response and are co-localized anatomically 
with 5 -HT sa receptors. 

Agents like 8-OH-DPAT, usually employed as a 5-HT 1A -specific agonist, 
interact additionally with 5-HT SA and 5-HT 7 receptors [24, 25, 32], There are 
data indicating that systemically injected 8-OH-DPAT induces phase shifts of 
circadian rhythms via 5-HT 1A receptor activation [37], while 8-OH-DPAT mi¬ 
croinjection into the dorsal raphe nucleus causes phase shifts through 5-HT 7 re- 
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Fig. 1 Distribution of 5-HT receptors in the circadian apparatus. IGL: intergeniculate 
leaflet of the thalamus; SCN: suprachiasmatic nucleus; DRN: dorsal raphe nucleus; 
MRN: medial raphe nucleus. 


ceptors [38], The local response to 8-OH-DPAT decreases as a function of age 
[38] together with an aging-induced decrease of 5-HT 7 receptor concentration 
[27], The 5-HT 7 receptor is the most recently described member of the large 
family of serotonin receptors [39], 5-HT 7 receptors are involved both in circa¬ 
dian rhythmicity and in thermoregulation [39^11], It has been speculated that 
the axon terminals of the glutamatergic cortico-raphe neurons may possess 5- 
HT 7 receptors [41], Activation of these 5-HT 7 receptors inhibits glutamate re¬ 
lease, which consequently leads to decreased activity of serotonergic neurons. 
Therefore, blockade of 5-HT 7 receptor might lead to an enhanced release of 
glutamate in the raphe with a consequent increase in the activity of serotonin 
neurons [40], 
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Another serotonin receptor, the 5-HT 1B receptor, also plays a role in circa¬ 
dian regulation. 5-HT 1B receptors are present on RHT terminals in the SCN 
[26] and decreased after bilateral ocular removal [36, 42], 5-HT 1B receptor ago¬ 
nists attenuate light-induced phase shifts and melatonin suppression by light 
[43] and, when directly applied on SCN neurons, they blunted the phase re¬ 
sponse to light [36], Studies in 5-HT 1B receptor-knockout mouse corroborated 
the fundamental role of 5-HT 1B receptors since those animals lacked the inhibi¬ 
tory control of retinal input to the circadian visual system [44], Frequency of 
GABAergic inhibitory currents in SCN neurons was reduced by 5-HT 1B recep¬ 
tor agonists in wild-type mouse, but not in 5-HT 1B receptor knockout mouse 

[45] 

The 5-HT 2C receptor is present in the SCN [31] and agonists of this receptor 
are able to induce phase delays in rats when injected at CT18, but not at CT6 

[46] , thus reproducing the effect of light. It is feasible that light acts through the 
retina-dorsal raphe projection in the rat and that the modulation by 5-HT 2C re¬ 
ceptors is exerted at this level [46], 5-HT 2C receptor agonists induce expression 
of FOS, Perl and Per2 in the rat SCN, an effect that is maximal at ZT16 [47], 

In the rat, but probably not in the mouse or hamster, there are two pathways 
though which light modulates SCN rhythmicity, i.e., the RHT and the direct 
projections from the retina to the dorsal raphe [48], Although a dorsal raphe 
projection to the SCN is absent in the rat [20], abundant dorsal raphe innerva¬ 
tion of peri-SCN neurons exists [49] providing glutamate signaling to the SCN. 
Presumably, it is through this pathway that the 5-HT 2C receptor contributes to 
the regulation of circadian rhythmicity. 


Melatonin receptors in SCN 

Melatonin is involved in the regulation of various physiological functions like 
the sleep-wake cycle, blood pressure, circadian rhythms, free radical scavenging 
and immune function (for reviews see [50-56]). Several of these effects of mela¬ 
tonin are exerted by acting through G protein-coupled MT t and MT 2 recep¬ 
tors located in the SCN [57], These effects are to be distinguished from those 
accruing from the introduction of supraphysiological amounts of melatonin 
from exogenous sources. Some of these are not receptor-mediated and involve 
metabolism, either in terms of formation of new bioactive compounds and/or 
interactions with free radicals [56], 

Melatonin has been used successfully in the treatment of insomnia in elderly 
individuals [58, 59], in CRSD, particularly in delayed sleep-phase syndrome 
(DSPS) [60-62], and in sleep disorders in children suffering from various neu¬ 
rological disorders [63-65], However, studies on the effects of melatonin in de¬ 
creasing sleep latency and total sleep are not always consistent, some investiga¬ 
tors reporting an absence of effects (see, e.g., [66, 67]). This has been attributed 
mainly to the short-half-life of melatonin. 
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As melatonin promotes and synchronizes sleep by acting on SCN melatonin 
MT, and MT 2 receptors, respectively, drugs with a longer duration of action 
on melatonin receptors may be beneficial in treating patients with insomnia. 
Hence, a number of melatonin receptor agonists have been developed and 
tested in humans [68-70], 

Melatonin secretion not only correlates with the timing of sleep, but also 
participates in sleep regulation through changes exerted on the SCN [71]. Neu¬ 
rons in the SCN express MT 2 and MT 2 receptors that have different functional 
roles. Melatonin causes acute inhibition of electrical activity in SCN neurons 
via MT t receptors, as shown in transgenic mice that lacked the expression of 
these receptors [72], In those animals, in which expression of MT 2 receptors 
was normal, the phase-shifting effect of melatonin persisted. From this and 
other studies it became clear that, while SCN MT, receptors mediate the inhibi¬ 
tory effects of melatonin, MT 2 neurons were essential for melatonin’s rhythm¬ 
regulating effect [72, 73], 

A reduction of sleep onset latency is the most consistently reported effect of 
melatonin administration. There is evidence that exogenous melatonin treat¬ 
ment of sleep disorders is most effective in cases where physiological melatonin 
production is deficient [58], Considerable improvements of sleep maintenance 
and duration have been obtained by using slow-release tablets of melatonin, a 
treatment that has also been found to reduce sleep latency. The reason for this 
is the very short half-life of serum melatonin, which is in the range of 20 min. 
Slow-release preparations of melatonin can extend the period of elevated se¬ 
rum melatonin levels to 5-7 h. 

A recent meta-analysis of the effects of melatonin in sleep disturbances, 
which included all age groups (and presumably individuals with normal mela¬ 
tonin levels), failed to document clinically meaningful effects of exogenous 
melatonin on sleep quality, efficiency or latency [67], The studies reviewed had 
a significant heterogeneity index and a low quality size effect estimation (shown 
by the wide 95% confidence intervals reported). Additionally, the reviewed pa¬ 
pers showed significant variations in the route of administration of melatonin, 
the dose administered and the way in which outcomes were measured, which 
made it difficult to draw conclusions in the meta-analysis [67], 

By contrast, another meta-analysis that comprised 17 studies involving 284 
subjects, most of whom were older, concluded that melatonin is effective in in¬ 
creasing sleep efficiency and reducing sleep onset time [74], Based on this meta¬ 
analysis the utility of exogenous melatonin treatment of insomnia, particularly 
in aged individuals with nocturnal melatonin deficiency, was proposed. 

A temporal relationship between the nocturnal increase of endogenous 
melatonin and “opening of the sleep gate” exists [75], Upon administration of 
melatonin in the afternoon, the sleep gate was advanced by 1-2 h, while expo¬ 
sure to 2 h of evening bright light between 20:00 h and 22:00 h delayed the next 
day rise in nocturnal increase of melatonin and the opening of the sleep gate 
[75], The period of wakefulness immediately prior to the opening of the sleep 
gate is referred as the wake-maintenance zone or “forbidden zone” for sleep 
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[76]; during this time the sleep propensity is lowest due to the increased activ¬ 
ity of SCN neurons [77, 78], The transition phase from wakefulness/arousal to 
high sleep propensity coincides with the nocturnal rise in endogenous mela¬ 
tonin [79], It was therefore proposed that melatonin contributes to the open¬ 
ing of the gate of nocturnal sleepiness by inhibiting the circadian wakefulness 
generating mechanism. This effect is thought to be mediated by MT, receptors 
at the SCN level. 

The circadian effects of melatonin to shift the biological oscillator are mani¬ 
fested in its effects on the timing of sleep. Morning administration delays the 
onset of evening sleepiness, while evening administration of melatonin advances 
sleep onset and other circadian rhythms [80, 81]. Phase shifting by melatonin is 
attributed to its action on MT 2 receptors present in the SCN [72], Melatonin’s 
chronobiotic effect is due to its direct influence on the electrical and metabolic 
activity of SCN, a finding that has been confirmed both in vivo and in vitro. 
Amplitude modulation by melatonin seems to be unrelated to clock gene ex¬ 
pression in the SCN [82], 


Agomelatine, a melatonergic agonist with 5-HT 2C and 5-HT 2B 
antagonist properties 


Most of the currently available antidepressant drugs act through monoamines 
and in particular serotonin. It has been demonstrated in the clinic that mood 
improvement in depressed patients who positively responded to treatment with 
various classes of antidepressants drugs could be rapidly impaired by 5-HT 
synthesis inhibition [83], Selective serotonin reuptake inhibitors (SSRIs) are 
clinically effective antidepressants. However, most patients do not show signs 
of mood improvement until 2-3 weeks after the start of the treatment and 
about one third of these patients show only partial or no response to the treat¬ 
ment [84], Several strategies are in progress to improve the activity of the con¬ 
ventional antidepressant drugs. Additional blockade of aminergic autorecep¬ 
tors (5-HT 1a , 5-HT 1b ) or antagonism of certain postsynaptic receptors (5-HT 2B , 
5-HT 2C ) are among these proposed strategies [85], 

The disruption of melatonin secretion in major depressive disorder was 
demonstrated in a number of studies (for references see [54]). As far as its 
antidepressant activity, melatonin (lOmg/day) was inactive to affect bipolar 
affective disorder [86] and improved sleep with no effect on symptoms of 
depression in major depressive disorder [87, 88], In seasonal affective disorder 
(SAD), melatonin (5 mg/day) was ineffective [89] while in patients with DSPS 
and comorbid depression, melatonin administration improved the circadian 
profile scores of sleepiness, fatigue, and alertness, thus having antidepressant 
properties [54], 

To improve the efficacy of melatonin’s sleep-promoting effects, several ana- 
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logs of melatonin have been developed for treating circadian rhythm sleep dis¬ 
orders or insomnia [68], Agomelatine is the first melatonin agonist having an¬ 
tidepressant activity [90], In preclinical studies, agomelatine has a high agonist 
affinity at MT, and MT 2 receptors [91]. Agomelatine is also an antagonist of 
5-HT 2C [92-94] and 5-HT 2B [92] serotonin receptors. Agomelatine displays an 
overall selectivity (> 100-fold) for MT, and MT 2 receptors as compared to other 
receptor sites, and its affinity for melatonin receptors is comparable to that of 
melatonin. Agomelatine has no significant affinity for muscarinic, histaminer- 
gic, adrenergic or dopaminergic receptor subtypes. 

Agomelatine can resynchronize disrupted circadian rhythms in animals [95], 
and this activity has been shown to be dose dependent and closely related to its 
plasma concentration [96], The chronobiotic activity of agomelatine has been 
confirmed by many studies (e.g., [97, 98]) and is due to an effect on electrical 
activity of SCN neurons that is similar to that of melatonin [99], The primary 
effect of melatonin in the rat SCN is inhibition of neuronal activity [100, 101], 
which is consistent with the relatively high expression of the MT, subtype in 
the circadian clock and the fact that this receptor is linked to enhancement of 
GABAergic activity [102], The effect of agomelatine on sleep and circadian 
rhythms can be predominantly attributed to its agonist activity at melatonin 
MTj and MT 2 receptors [90], 

Agomelatine was found effective in several animal models of depression 
such as learned helplessness [103], chronic mild stress [104], forced swimming 
[93], transgenic mouse with decreased glucocorticoid receptor expression [105] 
and psychosocial stress in tree shrews [106], Multicenter placebo-controlled 
studies support the efficacy of agomelatine in the treatment of major depres¬ 
sive disorders [83, 107], The anxiolytic activity of agomelatine may be clinically 
relevant since many depressed patients have also anxiety symptoms [108], 

To what extent agomelatine can be more effective than currently available 
antidepressants to treat major depressive disorders should be further explored. 
Indeed, classical antidepressants interact with 5-HT 1A receptors that cause 
various side effects like gastrointestinal problems, sleep disturbances, and sex¬ 
ual dysfunctioning, an effect not shared by agomelatine [90], The success of 
agomelatine in Phase III clinical trials for the management of major depressive 
disorders is attributed to its combined activity as a melatonin receptor agonist 
and 5-HT 2C receptor antagonist. A recent study indicates that SAD may be ef¬ 
fectively and safely treated with agomelatine [109], 


Circadian rhythm sleep disorders 

Among the innumerable periodic changes that underlie and support the overt 
circadian physiological rhythms, the peak values of rhythm occur in a charac¬ 
teristic sequence over the day (“phase map”) in human healthy subjects [110]. 
Such a sequence and spacing reflects the order and temporal relationships of 
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cause-effect in the normal interactions of the various bodily processes and 
is the very indicative of organism’s health [111]. Disruption of amplitude or 
phase of circadian rhythms can be produced endogenously, like that seen in 
many psychiatric disorders, blindness, CRSD or chronic diseases. 

On the other hand, phase maps may undergo transitory disruptions when 
humans are compelled to make a rapid phase adjustment as, for example, after 
a rapid move to a new geographic longitude or as a consequence of shift work 
[112, 113], Under such circumstances the various individual 24-h components 
comprising the circadian phase map do not reset their phases to the new en¬ 
vironmental times at the same rate, and become somewhat displaced in their 
relations to one another. 

CRSD comprise time zone change syndrome (“jet lag”), shift-work sleep 
disorder, irregular sleep-wake pattern, DSPS, advanced sleep-phase syndrome 
(ASPS), and non-24-h sleep-wake disorders (Fig. 2). Not all these subgroups 
require the same action to compensate the altered sleep rhythm. Jet lag and 
shift-work syndromes need acceleration or prevention of the re-entrainment of 
the sleep-wake rhythm by phase shifting, whereas DSPS and ASPS are perma¬ 
nent situations involving an altered phase relationship between sleep-wake and 
L/D cycles and thus impaired entrainment processes. Non-24-h sleep-wake dis¬ 
orders are observed in, for example, blind persons, who require the entrainment 
of their free-running circadian sleep-wake cycle, while the irregular sleep-wake 
pattern involves a chaotic 24-h pattern of the sleep-wake rhythm and necessi¬ 
tates the reorganization of the circadian pacemaker by other Zeitgebers. 

CRSD have become the major focus of attention in recent years. Major 
industrial, air and train accidents have been generally attributed to inefficient 
handling of situations by individuals suffering from malfunctioning the circa¬ 
dian time keeping system. Decrease in nighttime alertness and performance 
coupled with poor day time sleep as seen in night shift workers is the main 
cause for increased number of accidents seen during night shift [114], Sleep- 
related vehicle accidents are 20 times higher at 06:00 h than at 10:00 h. Working 
at the time of circadian trough associated with loss of sleep exerts a negative 
impact on work performance [114], 

Synchronization of the sleep-wake rhythm and the rest-activity cycles with 
L/D cycle of the external environment is essential to maintain a normal men¬ 
tal and physical health. Melatonin seems to be essential for this physiological 
adaptation; indeed drastic alterations in the secretion of melatonin with distur¬ 
bance of its rhythmicity have been shown to underlie CRSD [7, 8,115], Shifting 
circadian rhythms back to normal in these disorders is associated with the cor¬ 
rect timing of melatonin rhythm. 


Delayed sleep phase syndrome 

Weitzman and his co-workers [116] first identified DSPS, which is mainly en¬ 
countered in young individuals [117], and is a common sleep-wake disorder 
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Fig. 2 Circadian rhythm sleep disorders. The gray bars represent behavior of a represen¬ 
tative circadian rhythm on successive days after changes in the light-dark (L/D) cycle; the 
black bars represent darkness (redrawn from [147]). 


that accounts for 10% of cases of chronic sleep disorders. The sleep onset time 
and wake time are delayed in some cases until 02:00-06:00 h in the morning. 
Neither sleep architecture nor the maintenance of sleep is affected [118]. How¬ 
ever, persons suffering from this disorder experience chronic sleep onset insom¬ 
nia and forced early awakening results in daytime sleepiness. It has been shown 
that the peak melatonin secretion occurred between 08:00 h and 15:00 h in 
some DSPS patients demonstrating the abnormal phase position of melatonin 
in this sleep disorder [118, 119]. 

A high sensitivity to light has been reported in 47% of patients suffering 
from DSPS and this supersensitivity to light could be involved in the patho¬ 
physiology of DSPS [120], Patients with DSPS also have disturbances of other 
circadian rhythms such as core body temperature (cBT), growth hormone and 
cortisol secretion, as well as hunger. 
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DSPS is the most frequently occurring form of CRSD. It was reported that 
83.5% of 322 CRSD patients were of the DSPS type [121], The prevalence of 
DSPS in adolescence is more than 7%. The onset of CRSD occurred in early 
childhood in 64.3%, the beginning of puberty in 25.3%, and during adulthood 
in 10.4% among the studied cases with DSPS [121], Even a minor brain injury 
or a head trauma can act as a trigger for the development of DSPS. DSPS 
can also follow whiplash injury [122], Frequently occurring jet lag or frequent 
changes in the time of shift work are risk factors for developing DSPS [120] 
and very often a prior history of depression is found [118]. DSPS persists even 
after remission of the depression, suggesting that DSPS may be a cause rather 
a consequence of depression. Some patients developed a chronic fatigue syn¬ 
drome-like clinical picture with late melatonin onset following viral infection, 
suggesting that viral encephalitis could be a cause of DSPS [123], 

The endogenous circadian period length that is the internal cycle in the 
absence external timing information, is increased (Fig. 2) [124], The sleep- 
wake cycle depends on a number of endogenous physiological parameters 
such as cBT, melatonin, cortisol, and other hormonal and metabolic profiles. 
Therefore, a change in the timing of the intrinsic body clock can result in the 
development of a delayed sleep-wake rhythm as is seen in DSPS [124], Be¬ 
sides longer endogenous circadian periods, an insufficient exposure to outdoor 
sunlight can also be a cause of DSPS. A delayed melatonin secretory pattern 
with peak melatonin secretion sometimes delayed until daytime also underlies 
DSPS [62] 

Archer et al. [125] investigated the link between DSPS and a length poly¬ 
morphism in the PER3 clock gene. They found that the length of the PER3 
repeat region identifies a potential genetic marker for DSPS. This finding has 
been supported by number of other studies [124, 126], 

Chronotherapy involves systematic delay of bedtimes and wake times over 
a period of days until the desired bedtime is achieved. Once achieved, strict 
adherence to the new sleep-wake cycle is critical for maintaining a positive re¬ 
sponse [116]. Although effective, chronotherapy is demanding and compliance 
is low. 

Following the successful application of bright light for resetting the endog¬ 
enous pacemaker, bright light treatment was used (>2500 lux) in the treatment 
of DSPS [127], The time of administration is important as phase advances are 
induced when light exposure is scheduled after the minimum of cBT and phase 
delays are induced when light exposure is scheduled before the minimum of 
cBT. Accurate assessment of the minimum cBT can be difficult, but as the maxi¬ 
mum of the 24-hour melatonin secretion corresponds with the minimum of the 
24-hour cBT, salivary melatonin measurement can be taken as a good index for 
determining the best time for exposure to bright light [119]. The duration of 
exposure to bright light in the treatment of DSPS differs from that used to treat 
other chronobiological disorders. 
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As the exogenous administration of melatonin has been shown to reset the 
biological clock, several investigators have used melatonin to treat DSPS pa¬ 
tients. Dahlitz and co-workers were the first to report a placebo-controlled 
study that demonstrated the efficacy of melatonin in the treatment of DSPS 
patients [128], Melatonin was administered orally in the dose of 5 mg at 22:00 h 
for a period of 4 weeks. In this study, it was noted that melatonin significantly 
advanced the sleep onset time by an average of 82 min with a range from 19 to 
124 min. The mean wakefulness time also advanced by 117 min. Other studies 
corroborated the initial observations [62, 120, 129], Melatonin may be the best 
treatment for DSPS, especially when combined with exposure to bright light in 
the morning. 


Advanced sleep-phase syndrome 

Changes in sleep patterns can, in part, be attributed to changes in the func¬ 
tioning of the circadian oscillator. The characteristic pattern of ASPS includes 
complaints of persistent early evening sleep onset and early morning awaken¬ 
ings [130], Typically, in ASPS, sleep onset occurs at around 20:00 h and wake¬ 
fulness occurs at around 03:00 h [124], A decreased quality of sleep is associated 
with increased awakenings occurring during the night. The ability to maintain 
correct phase relationships among circadian rhythms is disturbed, possibly due 
to attenuation of the melatonin rhythm. Leger et al. [58] in studies undertaken 
in 517 human subjects aged 55 years and above noted a significant decline in 
6-sulfatoxymelatonin excretion in subjects suffering from insomnia. Melatonin 
replacement therapy in a dosage of 2 mg as controlled release tablets improved 
sleep quality significantly. Improvement in alertness and behavioral integrity 
was also noted in these subjects. From this study the authors concluded that de¬ 
cline in melatonin production associated with age impairs the sleep ability [58], 
They also concluded that melatonin promotes sleep perhaps through circadian 
entraining effects rather than by sleep-regulating effect. 

The genetic testing of ASPS families by a number of investigators has shown 
that ASPS is a familial disorder [124, 126], An autosomal dominant mode of 
inheritance of ASPS has been documented. An interesting finding in some of 
the studies is that there is not only an advancement of sleep-wake rhythm but 
also an advancement of melatonin rhythm as well. The familial ASPS gene 
hPer 2 has been localized near the telomere of the chromosome 2q. Human Per 
2 comprises 23 exons and study of the sequences of exon 17 in a large family 
with advanced sleep phase syndrome revealed that in the exon 17, a substitu¬ 
tion of serine at amino acid 662 with glycine occurred [124, 126], 
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Jet lag 

Rapid transmeridian flight across several time zones results in a temporary mis¬ 
match between the endogenous circadian rhythms and the new environmental 
L/D cycle. As a result endogenous rhythms shift in the direction of the flight; 
an eastbound flight will result in a phase advance of rhythms, while westbound 
flight will result in phase delay. As different rhythms take different times to re¬ 
establish their normal phase relationship, a transient desynchronization of cir¬ 
cadian rhythms occurs giving rise to symptoms such as altered (and transient) 
sleep pattern (e.g., disturbed night time sleep, impaired daytime alertness and 
performance), mood and cognitive performance (e.g. irritability and distress), 
appetite (e.g. anorexia), along with other physical symptoms such as disorien¬ 
tation, fatigue, gastrointestinal disturbances and light-headedness that are col¬ 
lectively termed as jet lag [131, 132], 

A number of studies have investigated melatonin’s potential for alleviating 
the symptoms of jet lag. Melatonin has been found effective for reducing the 
subjective symptoms of jet lag such as sleepiness and impaired alertness. The 
most severe health effects of jet lag occur following eastbound flights, since 
this requires a phase advancement of the biological clock. Melatonin has been 
found useful in causing 50% reduction in subjective assessment of jet lag symp¬ 
toms in 474 subjects taking 5 mg fast release tablets [133], Therefore, with few 
exceptions, a compelling amount of evidence indicates that melatonin is use¬ 
ful for ameliorating jet-lag symptoms in air travelers (see meta-analysis at Co¬ 
chrane Data Base [134]). 

One of us examined the timely use of three factors (melatonin, exposure 
to light, physical exercise) to hasten the resynchronization of the sleep-wake 
cycle in a group of elite sports competitors after a transmeridian flight across 
12 time zones [135], Outdoor light exposure and physical exercise were used 
to cover symmetrically the phase delay and the phase advance portions of the 
phase-response curve. Melatonin taken at local bedtime helped to resynchro¬ 
nize the circadian oscillator to the new time environment. Individual actograms 
performed from sleep log data showed that all subjects became synchronized 
in their sleep to the local time in 24-48 h, well in advance to what would be 
expected in the absence of any treatment [135], More recently, a retrospective 
analysis of the data obtained from 134 normal volunteers flying the Buenos 
Aires-Sydney transpolar route in the last 9 years was published, which further 
supports such a role for exogenous melatonin in resynchronization of sleep 
cycles [136], 


Shift-work sleep disorder 

In modem industrialized society, a large number of workers are engaged in 
work schedules that include either daytime or night work. It has been estimated 
that at least one fifth of total global work force operates in rotating shift work. 
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These individuals are forced to forego their nocturnal sleep while they are on a 
nightshift, and sleep during the day. This inversion of the sleep-wake rhythm 
with work at night at the low phase of the cBT rhythm and sleep at the time 
of peak cBT has given rise to insomnia-like sleep disturbance [137], Sleep loss 
impairs the individual’s alertness and performance that affects not only work 
productivity, but also has been found to be a major cause for industrial and 
sleep-related motor vehicle crashes [114], Sleep-related crashes occur most 
commonly in the early morning hours (02:00-06:00 h). The loss of sleep is re¬ 
ported in night shift workers, even when engaged in day work soon after the 
onset of night shift. Sleep deprivation and the associated desynchronization of 
circadian rhythms are common in shift-work sleep disorder [137], 

A phase delay in plasma melatonin was noted in shift workers when mela¬ 
tonin was administered at the morning bedtime following the night shift [138], 
The shift in melatonin secretion has been associated with increase in work per¬ 
formance as well. Correctly timed administration of melatonin is advocated for 
hastening adaptation of circadian rhythms in shift workers [139-141], Mela¬ 
tonin (1.5 mg at 16:00 h) was able to advance the timing of both endogenous 
melatonin and cortisol rhythms without causing any deleterious effects on en¬ 
docrine function or daytime mood and sleepiness. Combinations of both bright 
light and melatonin could also be an effective and reliable strategy for treating 
shift-work disorder [142], 


Non-24-h sleep-wake disorder 

Non-24-h sleep-wake disorder is seen mostly in blind human subjects since 
their sleep-wake cycle is usually not synchronized to the 24-h L/D cycle. These 
subjects suffer from recurrent insomnia and daytime sleepiness. The circadian 
rhythm of sleepiness has shifted out of phase with the desired time for sleeping. 
Melatonin has been shown to phase shift the human circadian system, by an 
advance or delay, according to phase response curve changes both at physiologi¬ 
cal and pharmacological doses [143], Therefore, melatonin has been employed 
to correct abnormal sleep-wake rhythms in blind human subjects. 

Melatonin treatment completely synchronizes sleep-wake cycle to a 24-h cy¬ 
cle in blind human subjects [144, 145], Lockley and his co-workers [144] phase 
advanced the rhythms to the correct position in three totally bind persons using 
5 mg melatonin. Sack and his co-workers [145] administered 10 mg melatonin 
for 3-9 weeks to seven totally blind persons and found that melatonin was ef¬ 
fective in inducing phase advances of the sleep-wake rhythms by 0.6 h/day. On 
reaching complete entrainment, the dose was gradually reduced and synchroni¬ 
zation of sleep-wake rhythms to the normal 24-h day schedule was maintained 
with a low dose of 0.5 mg that resulted in plasma melatonin concentrations 
close to the physiological range. The beneficial effects of melatonin could be 
attributed not only to its entrainment properties but also to its direct soporific 
effects [146, 147], 
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Conclusion 

Normal circadian rhythms are synchronized to a regular 24-h environmental 
L/D cycle. Both serotonin and melatonin are essential for this adaptation and 
their receptors are widely distributed in the circadian apparatus. Desynchro¬ 
nization of circadian rhythms, as occurs in chronobiological disorders, results 
in severe disturbances of sleep. Common CRSDs are DSPS, ASPS, non-24-h 
sleep-wake rhythm disorder, jet lag, and shift work. Depression also exhibits 
circadian rhythm disturbances. Disturbances in the phase position of plasma 
melatonin levels have been documented in all these disorders. Whether this mela¬ 
tonin disruption is a cause or a consequence of these disorders is not known. 
Further research with of a large number of patients with CRSD can help de¬ 
termine the association. 

Melatonin has been found useful in treating the disturbed sleep-wake 
rhythms seen in DSPS, non-24-h sleep-wake rhythm, shift-work sleep disorder 
and jet lag. In most of these conditions an abnormal phase position of melato¬ 
nin rhythm has clearly been documented. ASPS has been found to be a familial 
disorder, the familial ASPS gene being localized near the telomere of the 2q 
chromosome. In these disorders, both the sleep-wake rhythm and melatonin 
secretion have been found to be phase advanced. 
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Abstract 

Serotonin (5-HT) is implicated in the regulation of both behavioral arousal and a brain¬ 
stem alerting system that operates in wakefulness and in rapid eye movement sleep (REM). 
Activation of the brainstem alerting system is marked by the presence of ponto-geniculo- 
occipital (PGO) waves that occur in association with orienting in wakefulness and spon¬ 
taneously in REM. Local application of serotonergic agents into REM and PGO wave 
regulatory regions can alter REM, but there is conflicting evidence as to whether 5-HT in 
the brainstem can independently influence PGO wave generation. A potential site of ac¬ 
tion of 5-HT outside the brainstem is the amygdala, which can influence arousal as well as 
neurobiological responses to novel and significant stimuli. The amygdala also modulates 
the occurrence and amplitude of PGO waves. We discuss the linkages between arousal and 
alerting systems and the role 5-HT may play in their regulation at brainstem and amygda- 


Introduction 

Serotonin (5-HT) has been implicated in the control of sleep and arousal and 
in the regulation of information gathering and processing in wakefulness. Nor¬ 
mally, one would expect these to be linked, and this appears to be the case 
in wakefulness where behavioral and electrophysiological signs of arousal and 
vigilance act in concert. During rapid-eye-movement sleep (REM), which para- 
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doxically shows signs of a highly alert brain concurrently with muscle atonia, 
which prevents overt behavior, serotonergic neurons are not active [1-3]. Never¬ 
theless, alert wakefulness and REM share several electrophysiological features 
[e.g., activated EEG, hippocampal theta, and ponto-geniculo-occipital (PGO) 
waves] [4-6], In wakefulness, these characteristics of “alerting” appear to sig¬ 
nify an animal’s registration of, and readiness to respond to, potentially impor¬ 
tant environmental stimuli. In REM, however, an essentially identical pattern 
of brain activity occurs in the absence of external stimuli and without behav¬ 
ioral arousal, thus suggesting that brain alerting and behavioral arousal and 
awareness can be dissociated. 

The potential for dissociation of these processes is demonstrated most dra¬ 
matically in animals exhibiting REM without atonia (REM-A). In this prepara¬ 
tion, bilateral lesions of the dorsal pontine tegmentum eliminate the atonia of 
REM and release elaborate behaviors, while leaving intact the largely unknown 
mechanisms that prevent arousal [7-9], PGO waves occur more frequently in 
cats when overt behavior is observed during REM-A [10]. In addition, high-am- 
plitude, isolated eye movements are correlated with orienting (OR) -like head 
movements, and bursts of rapid eye movements are usually related to more 
generalized body movements, such as jumping or attacking [11], With lesions 
producing sufficient release of behavior, cats can behaviorally orient to external 
auditory stimuli without awakening during REM-A [12], Behavioral OR dur¬ 
ing REM-A can include ear pinna rotation and turning of the head toward the 
stimulus source in much the same manner as OR observed in wakefulness [12], 
These responses occur at the same time that most of the electrophysiological 
signs of REM (except atonia) are present. 

Behavioral OR to external stimuli in REM-A indicates that sensory infor¬ 
mation is being processed. Interestingly, studies of evoked potentials indicate 
that sensory information reaches the thalamus and cortex during wakefulness 
and REM, but that responses are attenuated in non-REM (NREM; reviewed in 
[13]). Thus, wakefulness and REM may differ in the way sensory information 
is processed, perhaps due to reduced weighting of sensory inputs in REM [13]; 
however, behavioral OR in both states seem very similar when atonia does not 
prevent an overt behavioral response to stimuli in REM-A. These observations 
have led us [14-16] to distinguish arousal (alternations between the levels of 
consciousness we refer to as sleep and wakefulness, identified using standard 
EEG and EMG criteria for wakefulness, NREM and REM) and alerting (a 
term we have used to refer to information gathering processes and responses to 
sensory input, including PGO waves during REM and even OR behaviors that 
can be expressed during REM-A). 

Both REM and alerting, as indicated by PGO waves, appear to be generated 
in the pons. Several rostrodorsal pontine structures linked to the regulation of 
REM are involved in alerting during wakefulness. These include cholinergic 
neurons in the laterodorsal tegmentum (LDT) and the pedunculopontine teg¬ 
mentum (PPT), noradrenergic (NA) neurons of the locus coeruleus (LC) and 
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serotonergic neurons of the dorsal raphe nucleus (DRN). Neurons in each of 
these regions have state-related changes in their firing patterns [17], respond to 
sensory stimulation [18-22], and have been implicated in alerting behaviors in 
wakefulness. Pontine cholinergic neuronal groups form essential components 
of the ascending reticular activating system and play an important role in mod¬ 
ulating cortical EEG as well as behavioral aspects of arousal and attention [17]. 
Noradrenergic LC neurons have been implicated in arousal and have been sug¬ 
gested to control vigilance by regulating attention to environmental stimuli [23, 
24], The serotonergic system has also been linked to cognition [25] and to the 
modulation of motor output [26] as well as to the control of arousal. A full 
understanding of the role(s) these neurons play in behavioral state regulation 
and alerting will clearly require additional investigation of their contributions 
to both wakefulness function and REM generation. 

Work in our laboratories and those of others have demonstrated that the 
alerting features common to wakefulness and REM may be modulated by a 
forebrain structure, the amygdala, which has been implicated in alerting and 
vigilance as well as its more established involvement in the regulation of emo¬ 
tional behavior. The results of recent work indicate that the amygdala has a 
significant role in the regulation of arousal, including alterations in wakeful¬ 
ness, NREM and REM. In this chapter, then, we focus on the neural control 
of alerting and behavioral arousal at both pontine and amygdalar levels with a 
special emphasis on the role of serotonergic mechanisms. 


Relationship of DRN neuronal activity to arousal and alerting 

While considerable evidence suggests that 5-HT is involved in regulating REM, 
one of the more compelling arguments that 5-HT silence is not necessary for 
maintaining REM comes from work in cats with pontine lesions, creating 
REM-A that permit overt behavior during REM-A yet exhibiting all of the 
characteristics of normal REM with the exception of skeletal muscle atonia 
[7-9], Recording DRN putative 5-HT neurons in these animals revealed that 
cells that decreased their firing rates in NREM compared to wakefulness could 
have increased firing during REM-A that was sixfold that of normal REM [27], 
While firing in these neurons was typically below rates in wakefulness, the most 
active neurons, found in cats exhibiting locomotion in REM-A, could fire at 
rates nearly reaching those seen in wakefulness. There could be dissociations 
between frequency of DRN firing and motor activity, but DRN neuronal firing 
often occurred in the presence of high muscle tone. These data suggest that the 
cessation of DRN firing during REM may be more related to the lack of mus¬ 
cle tone than to the maintenance of REM. However, it should be stated that 
a study of seven REM-off DRN neurons in normal cats did not find a consis¬ 
tent relationship between their firing and muscle tone across the complete sleep 
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cycle [28], This was evidenced by a reversal from a negative to a positive cor¬ 
relation between DRN activity and muscle tone from the first to second half of 
the sleep cycle, and the observation that a mid-cycle increase in muscle tone was 
associated with reduced DRN activity. Thus, the exact relationship between the 
activity of DRN 5-HT neurons and state control and muscle tone across the 
sleep cycle remains to be fully elucidated, although there is other evidence that 
DRN firing is related to motor control. 

In cats, peripheral paralytic agents do not affect DRN firing rates, whereas 
DRN silence does occur during cataplexy produced by carbachol infusion into 
the pons [29], These observations have led to the hypothesis that DRN 5-HT 
neurons facilitate motor output [29], Indeed, movement-related cells have been 
described in the cat DRN [26], Furthermore, increased 5-HT at motoneuronal 
synapses increases muscle tone and activates motor outputs [30, 31]. Although 
5-HT does not by itself change motoneuronal activity, it does facilitate the ef¬ 
fects of excitatory amino acids applied directly to motoneurons or electrical 
stimulation of various motoneuronal inputs [32, 33], There is also evidence that 
5-HT modulates both GABAergic inhibitory and glutamatergic excitatory in¬ 
puts in the pallidum, thus participating in the control of movement at the level 
of the basal ganglia [34], 

Two major classes of neurons in DRN have been described: one with “broad” 
action potentials (1-2 ms) and slow firing rates, thought to be serotonergic; and 
another with shorter duration spikes and faster firing rates, often thought to be 
GABAergic (reviewed in [35]). Spike width has often been used as a means of 
identifying serotonergic neurons that show state-related changes in discharge 
[1-3]. However, a recent study of a large number of cells in DRN reported that 
about one third of broad spike neurons did not reduce their firing rates during 
sleep and that a large percentage of these were active during REM [35], DRN 
has also been reported to contain another class of possibly 5-HT neurons with 
classical “broad” spike characteristics, but which have a “burst” firing pattern 
and neurons with high frequency firing (10-40 Hz; 55-70 Hz) with activity re¬ 
lated to hippocampal theta, that are not silent during REM [36], 

Work using juxtacellular methods to record and identify neurons in the 
DRN of anesthetized rats has found evidence for two main populations of 
neurochemically identified serotonergic neurons; one that fit the “classical” 
clock-like firing seen in neurons with state-related patterns of activity [25, 37] 
and another with firing phase-locked to the hippocampal theta rhythm [25], 
Other neurochemically identified serotonergic neurons could not be distin¬ 
guished from non-serotonergic neurons based on firing characteristics [25, 37], 
Thus, DRN appears to contain distinct classes of serotonergic neurons as well 
as non-serotonergic neurons, some lacking the state-related discharge patterns 
typically ascribed to serotonergic neurons in DRN. 

There is also evidence that DRN contains topographically distinct popula¬ 
tions of serotonergic neurons that may serve different functional systems [38, 
39], Kocsis et al. [25] suggested that the serotonergic system is involved in the 
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processing of information in ways that go beyond regulating arousal states. 
Therefore, further attention paid to the different classes of serotonergic neu¬ 
rons may aid in understanding the role(s) of 5-HT in regulating arousal state 
and in regulating motor and other behaviors in wakefulness. 


PGO waves as indicators of alerting 

PGO waves (or spikes as they were originally named) are macropotential waves 
first recorded in the pontine tegmentum, lateral geniculate body and the oc¬ 
cipital (visual) cortex of cats, hence the acronym [40-43], The last two sites 
in particular reflected the early interest in dreams and eye movements among 
early sleep researchers. In cats, the waves are essentially limited to about 30 s 
preceding the onset of REM and for the duration of that state. Only a few 
waves precede REM in rats [44], Two types of PGO waves have been recorded 
in cats: those occurring singly and those appearing as bursts during an episode 
of REM. The latter were eliminated following bilateral lesions in the vestibular 
nuclei that also blocked the occurrence of rapid eye movements [45], suggesting 
that the PGO bursts are reinforced by the nystagmoid rapid eye movements. 
Datta [46] has reviewed his laboratory’s work that revealed interactions between 
the pontine generator site identified by him and the vestibular nuclei, support¬ 
ing the observations of Morrison and Pompeiano [45], The single waves gener¬ 
ated in the caudolateral parabrachial and subcoeruleus areas, [46] then, appear 
to be a primary element of REM, unlike the eye movement-associated bursts. 

Difficulties in recording similar waves in the lateral geniculate body of the 
albino rat led to some speculation that the fundamental PGO wave did not 
occur in this common laboratory animal, which tended to obscure what we 
believe to be a general phenomenon across mammalian species [44,47], In fact, 
macropotential waves were later recorded in the dorsolateral pontine tegmen¬ 
tum that preceded the onset of REM as in cats [44, 48, 49], Datta [50] has 
demonstrated that the pontine generator cells do not project directly to the lat¬ 
eral geniculate body in the visually deficient albino rat, possibly explaining the 
earlier difficulties. 

The focus on eye activity and dreams may have led workers away from what 
is, in our opinion, the real significance of PGO waves: a sign of alerting in 
the brain, a fundamental (and “peculiar”) aspect of REM. The idea that PGO 
waves are a sign of an “alert” brain largely cut off from, or at least minimally 
responsive to, both external and internal influences arose when Bowker and 
Morrison [51, 52] demonstrated in cats that auditory stimulation (90 dB level) 
would elicit PGO waves (PGO E ) during REM and even NREM. The same re¬ 
sults were later obtained in rats [44], 

At the cellular level, Hu et al. [53] found that PGO waves in the lateral genicu¬ 
late body of cats resulted from nicotinic activation of the projecting neurons 
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with a parallel muscarinic inhibition of perigeniculate cells stemming from 
activation by pontine peribrachial cholinergic neurons. They confirmed that 
auditory stimuli elicited PGO E in the lateral geniculate body and concluded, in 
agreement with the earlier work, that “these signals are the central correlates of 
orienting reactions elicited by sensory stimuli during waking (the so-called eye 
movement potentials) and by internally generated drives during paradoxical 
sleep” (p. 25) [53], 

More recent work with waves elicited by tones in wakefulness has reinforced 
this hypothesis. Sanford et al. [16], using cats, found that tones that elicited 
PGO e waves in the lateral geniculate body during REM also elicited waves 
of comparable amplitude if the animal oriented to the tone source. When the 
animal did not orient the waves were of smaller amplitude even though most 
tones elicited a wave (Fig. 1). Sanford et al. concluded that the mere presence 
of PGO e indicates that stimulus information has been registered, and that 
brain alerting mechanisms have been readied, although an overt behavioral re¬ 
sponse may not be forthcoming. Activation of central orienting mechanisms is 
reflected in larger amplitude PGO E . The phenomena of high-amplitude PGO E 
accompanying OR in waking, the high-amplitude PGO waves of REM and the 
spontaneous “OR” of REM without atonia are all evidence that certain brain 
orienting mechanisms are spontaneously activated during REM [4, 6], Sanford 
and colleagues reasoned that PGO E of wakefulness signaled the enhancement 
of information transfer in the lateral geniculate body [54, 55] that would natu¬ 
rally accompany visual orienting in cats. 

Fear conditioning, achieved by presenting rats with light pulses accompa¬ 
nied by foot shocks, induced an increase in the amplitudes of PGO E evoked by 
white noise bursts when they were accompanied by the light-pulse conditioning 
stimulus alone in test sessions 24-48 h after the conditioning session [56], Be¬ 
cause the amygdala is a key structure for the induction of fear in a conditioning 
paradigm [57], we reasoned that stimulation of the amygdala during wakeful¬ 
ness would affect the pontine cells generating the PGO alerting signal [58], In¬ 
deed, electrical stimulation of the central nucleus of the amygdala (CNA) con¬ 
comitant with a tone or within 25 ms preceding the tone elicited PGO waves 
of significantly higher amplitudes than those evoked by tones alone. The effect 
on PGO e waves paralleled the effect on the acoustic startle response, which is 
known to be potentiated by amygdalar stimulation [59, 60], 

Although 5-HT facilitates motor activity, it generally suppresses transfer 
of sensory transmission. Of great relevance here, 5-HT inhibits information 
processing in the lateral geniculate body [61, 62], Furthermore, Fornal et al. 
[26] found that the approximately 25% of neurons in the dorsal raphe nucleus 
strongly activated during chewing, licking and grooming movements, and also 
by sensory stimulation of the face, head and neck, ceased firing for 1-5 s when 
cats oriented to a strong or novel stimulus. The silence of 5-HT neurons dur¬ 
ing REM [1,2], which is accompanied by a release of spontaneously occurring 
high-amplitude PGO waves, is, of course, consistent with the view that PGO 
waves are a sign of alerting during REM. 
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Fig. 1 Elicited ponto-geniculo-occipital (PGO) waves and behavioral orienting in cats 
across blocks of 40 trials of stimulus presentations in wakefulness, NREM and REM 
plotted as a percentage of the initial trail. Data in wakefulness came from the first day 
of experimental testing, whereas the data for NREM and REM could have come from 
either the first or second day. Note that because data were averaged across cats, the re¬ 
lative change across trials is a reflection of proportion of animals responding, as well 
as amplitude and difference score; n=13. W1-W6: Six separate blocks of 40 trials in 
wakefulness (W). Reprinted with permission from [16] 


Serotonin and pontine regulation of arousal and alerting 

Support for the hypothesis that 5-HT is a significant regulator of REM and PGO 
waves was found in studies that systemically administered drugs that influenced 
the serotonergic system. Classic studies also found that the administration of 
5-HT-depleting drugs, such as p-chlorophenylalanine (PCPA) and reserpine, re¬ 
leased PGO waves into states other than REM in cats [63-67], although in rats, 
studies of the effects of PCPA on the release of PGO waves are contradictory 
with one study reporting no effect [68] and another reporting increased waves 
in wakefulness but an overall reduction during 24-48 h recordings [69], Reser¬ 
pine also depletes norepinephrine; however, because 5-HT precursors blocked 
the induction of PGO waves by reserpine more than catecholamine precursors, 
the effects on PGO waves were thought to be due to the effects of reserpine on 
5-HT [65], The number of reserpine-induced PGO waves in cats is also reduced 
by systemic administration of the 5-HT 1A agonist, 8-OH-DPAT [70], Other evi- 
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dence for the involvement of 5-HT in the regulation of PGO waves and REM 
came from studies demonstrating that lesions of DRN and knife cuts between 
DRN and the dorsolateral pons [71] released PGO waves into wakefulness, 
whereas electrical stimulation of DRN suppressed PGO waves during REM 
[72], Inhibition of DRN via microdialysis of 8-OH-DPAT, a relatively specific 
5-HT 1A autoreceptor agonist, increased REM in cats [73], but systemic admin¬ 
istration to cats of the 5-HTj agonist, eltoprazine, produced a significant reduc¬ 
tion in REM and PGO waves and an increase in NREM without significantly 
altering wakefulness [74], 

Although several lines of research have demonstrated a role for 5-HT in regu¬ 
lating REM [73] and PGO waves [65, 66, 71], the exact sites where 5-HT exerts 
these effects are not well known. In addition, studies locally administering drugs 
into specific brain regions have sometimes yielded apparently conflicting results, 
especially if one considers findings across brain regions and in different species. 
A number of studies have examined the role of 5-HT in regulating arousal and 
PGO waves via microinjection into key REM regulatory regions in the brain¬ 
stem, including the cholinergic LDT and PPT. These regions are thought to 
play a major role in generating REM and phasic REM events, including PGO 
waves [17, 75], Some putative cholinergic neurons in LDT and PPT show tonic 
increases in firing during REM, whereas work primarily in cats has found other 
neurons that fire in bursts immediately preceding PGO waves [76-80], These 
patterns contrast with some 5-HT neurons in DRN that fire minimally in REM 
[1-3]. Thus, it has been proposed that 5-HT released from DRN suppresses 
LDT and PPT activity, and hence, REM and PGO waves [81, 82], In support of 
this hypothesis, Luebke et al. [83] found that cholinergic “burst” neurons in in¬ 
fant rat LDT were inhibited by 5-HT and by carboxamidotryptamine maleate 
(5CT), a 5-HT, agonist, in vitro, in a manner consistent with the hypothesized 
role of DRN in the control of PGO waves. However, neurons with bursting 
patterns of firing were not found in in vivo recordings of LDT in mature rats 
[78], Also, in cats, systemically administered 5-Me-ODMT (5-methoxy-A,A- 
dimethyl-tryptamine), a 5-HT autoreceptor agonist [84], and iontophoretically 
applied 5-HT [85] did not alter the firing of PGO “burst” cells. 

In cats, we found that local microinjections of the 5-HT 1A agonist, 8-OH- 
DPAT, into the peribrachial region of PPT (PB), a site of burst cell activity in 
cats, and putative site for PGO wave generation [77, 80, 86], reduced the num¬ 
ber of successful entrances into REM, but did not impact episode duration or 
PGO wave activity once REM had successfully been entered [87], The incidence 
of transitional sleep, indicated by periods of NREM showing PGO waves, was 
also not reduced. Similarly, in rats, local microinjections of 5-HT into LDT 
suppressed REM but did not affect PGO wave frequency [88], Similar effects 
were seen in a small number of rats microinjected into LDT with 8-OH-DPAT. 
By comparison, microinjections of the broad-spectrum 5-HT antagonist, me- 
thysergide, did not enhance REM amounts or alter PGO wave activity, but did 
increase transitional sleep [88], Local microinjections of 8-OH-DPAT into PPT 
of rats also failed to inhibit tone-elicited PGO waves recorded in the pons [89], 
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It has also been reported that local microinjections of 5-HT into PPT of rats 
did not alter REM or spontaneous PGO waves [90], These findings are com¬ 
plemented by autoradiographic studies that revealed few 5-HT 1A receptor sites 
in rat PPT, and only a moderate amount of labeling in LDT [89], It should 
be noted, however, that there were procedural differences between our study 
reporting a significant reduction in REM after microinjections of 5-HT into 
LDT [88] and one reporting a lack of effect on REM after microinjections of 
5-HT into PPT [90] that could have accounted for the differences. Our micro¬ 
injections into LDT were remotely controlled with bilateral injection initiated 
after the onset of REM and occurring multiple times during the recording pe¬ 
riod, although always separated by at least 1 h [88], In the study examining the 
effects of microinjections of 5-HT into the PPT, a single unilateral injection 
was administered prior to recording [90], In our study, the most 5-HT-induced 
REM suppression occurred within 20 min after the injection, suggesting a rela¬ 
tively short-lasting effect. 

In rats, the generation of PGO waves (sometimes referred to as “P” waves 
because they are recorded locally in the pons [91—93]) has been localized to the 
dorsal region of the nucleus subcoeruleus [50], This region is in or near the 
site where PGO waves were originally recorded in rats [44, 49, 94, 95], Datta 
et al. [90] reported that unilateral microinjections of 5-HT into the generator 
region of rats produced a substantial reduction in PGO wave activity without 
significantly altering REM. Reductions in PGO wave activity were found only 
ipsilateral to the injection site and persisted for 5 h post injection. This study 
provides the clearest evidence to date that 5-HT can directly inhibit PGO waves 
when applied in the generator site, although the duration of the suppression 
is interesting given the relatively short duration of effect on REM when 5-HT 
was applied in LDT [88] and amygdala [96]. 

5-HT 2 receptors have been found in close association with brainstem cholin¬ 
ergic cells in rats [97, 98], suggesting that a 5-HT 2 receptor mechanism may be 
involved in the modulation of these cells. However, a subclass of 5-HT 2 recep¬ 
tors is located on noncholinergic, hypothetically GABAergic, intemeurons sur¬ 
rounding mesopontine cholinergic cells [99], Since 5-HT 2 receptors have been 
shown to be excitatory (reviewed in [100]), putative excitatory effects of 5-HT 2 
agonists on inhibitory interneurons [99] could explain the inhibitory effects of 
a 5-HT 2 agonist on LDT cholinergic neurons. Indeed, we found that locally 
microinjecting the 5-HT 2 agonist DOI [(F)-l-(2,5-dimethoxy-4-iodophenyl)-2- 
aminopropane HC1] and the 5-HT 2 antagonist, ketanserin, into LDT in rats 
significantly decreased or increased, respectively, the number, but not the du¬ 
ration, of REM episodes [101]. DOI specifically decreased the occurrence of 
clusters of REM episodes appearing at intervals of 3 min or less (sequential 
episodes) without affecting single episodes separated by more than 3 min. Ket¬ 
anserin, at the dosages examined, produced a non-significant tendency towards 
an increase in REM clusters. 

In cats, our laboratory found an increase in REM percent with systemically 
administered ketanserin [102], whereas another 5-HT 2 antagonist, ritanserin, 
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has been reported to decrease both NREM and REM [103], By comparison, in 
cats, microinfusion of DOI, ketanserin, and the nonspecific 5-HT antagonist, 
methysergide, locally into the peribrachial region of PPT (PB) did not signifi¬ 
cantly alter behavioral state or PGO wave activity, although there were nonsig¬ 
nificant tendencies for increased REM at certain concentrations of ketanserin, 
and decreases in REM at certain concentrations of DOI [104], Microinjec¬ 
tions into PB of the less-specific 5-HT agonist, l(3-chlorophenyl) piperazine 
(mCPP), also did not significantly alter either behavioral state or PGO wave ac¬ 
tivity [87], Interestingly, at the time of this study, mCPP was considered an ago¬ 
nist at 5HT 1B/C receptor sites, but the 5-HT lc receptor site was later reclassified 
as a 5 -HT 2c receptor subtype because of its homologous nucleotide sequences 
with other 5-HT 2 receptors [105, 106], 

While effort has been directed at examining the influence of the 5-HT sys¬ 
tem on cholinergic and REM regulatory regions in the brainstem, anatomi¬ 
cal studies in rats have found only low to moderate input into PPT/LDT from 
DRN [107-109], and there may be relatively few 5-HT synapses on choliner¬ 
gic neurons in PPT/LDT [110]. Synapses observed on cholinergic neurons are 
asymmetrical, a feature associated with excitation, not inhibition [110]. Ap¬ 
proximately 2-4% of the total synaptic input to both ChAT-immunoreactive 
dendrites and surrounding, noncholinergic neuropil is serotonergic, indicating 
that serotonergic input is not skewed toward cholinergic neurons in PPT [109], 
In cats, a preliminary report based on two animals found only a weak projec¬ 
tion from DRN to LDT [111], This study did not mention any projections from 
DRN to PPT, and we are unaware of other such studies in the literature. DRN 
5-HT projections to other regions implicated in the generation of REM and 
PGO waves are also limited. This includes the cholinoceptive nucleus pontis 
oralis [112] and the lateral PB region [113] that has been demonstrated in cats 
to be important in the generation of PGO waves and REM [114], 

Thus, while considerable evidence indicates a role for 5-HT in regulating 
REM and PGO waves, anatomical studies, negative findings in single-unit 
studies [85] and findings that local applications of several compounds active at 
5-HT receptor sites in PPT/LDT do not alter PGO wave activity suggest that a 
DRN 5-HT mechanism probably does not directly influence these regions with 
respect to PGO wave generation. The work of Datta et al. [90] indicates that 
5-HT may directly inhibit the PGO wave generator in rats, although our own 
work in cats [87, 104] failed to find evidence that 5-HT drugs locally applied 
in PGO wave generator regions could alter PGO wave activity independently 
of alterations in REM. The reductions in PGO waves after microinjec¬ 
tions into nucleus subcoeruleus and no effect on REM or PGO waves after 
microinjections into PPT led Datta et al. [90] to suggest that 5-HT inhibition 
of REM and REM-related phenomena could be mediated through actions 
on individual REM sign generators though the differences in actions across 
generators has not been resolved. Our own work suggests that some of the 
influence of 5-HT on REM and its related phenomena may involve its effects 
in the amygdala. 
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Role of serotonin in the amygdala in regulating 
arousal and alerting 


The amygdala occupies an important position among forebrain regions known 
to modulate fundamental arousal mechanisms [115, 116]. Recently, it has be¬ 
come evident that 5-HT inputs to the amygdala have a significant role in this 
modulation [96,117,118], We review here findings from a wide array of studies 
that have established amygdalar participation in arousal and sleep-wake con¬ 
trol; the basic neuroanatomy of the amygdala, with an emphasis on its seroto¬ 
nergic innervation; and the growing literature on 5-HT influences on the amyg¬ 
dalar contribution to the control of arousal and sleep-wake behavior. 

The importance of the amygdala in identifying aversive stimuli, mediating 
conditioned fear responses, and storing fearful memories has long been recog¬ 
nized [119]. Rolls [120], however, recognized that amygdalar neurons operate 
as filters for stimuli associated with positive as well as negative reinforcers and 
reinforcers that operate by virtue of their “relative unfamiliarity.” Consistent 
with this conception of amygdalar function as different from one specifically of 
fear detection and fear response implementation is the suggestion that the baso- 
lateral amygdala’s role in fearful behavior depends on the evaluation of sensory 
information along an arousal axis as well as an emotional valence axis [121— 
123], In both cats and rabbits, the most likely response to electrical stimulation 
of the CNA, the major amygdalar output station, was attending or orienting 
[124-126], There are reciprocal connections between the CNA and the choliner¬ 
gic basal forebrain, which projects to the cortex [127,128], Consequently, Kapp 
et al. [129] concluded that efferent pathways from the CNA likely “contribute 
to a coordinated pattern of responses which can best be interpreted within an 
arousal or nonspecific attentional framework.” Holland and Gallagher [130] 
have demonstrated that CNA-dependent attentional processes are crucial to 
associative learning in the rat. Functional neuroimaging studies in humans 
have now shown that amygdalar activation during fear conditioning to a visual 
stimulus is limited to the early acquisition trials, when response contingencies 
are changing. Similarly, it is early in extinction training, a time of shifting re¬ 
sponse contingencies, that amygdalar activation is most prominent [123, 131, 
132], Even the involvement of the amygdala in the enhanced retrieval of mem¬ 
ories for emotionally salient events has been attributed to an arousal function, 
the notion being that the amygdala communicates with essential brainstem and 
diencephalic arousal systems that, during fearful memory retrieval, activate the 
forebrain to a level equivalent to that during memory encoding [133], 

In agreement with the view that REM is a sleep state characterized by alert¬ 
ing to endogenous stimuli, CNA activation is associated with REM, as well as 
with arousal during waking. Electrical stimulation of the CNA in rats promoted 
REM [134], while chemical inactivation of this structure with muscimol and 
functional inactivation with tetrodotoxin suppressed REM [135, 136], There is 
substantial evidence, in several species, that CNA also modulates the genera- 
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tion of PGO waves, a signature of alerting during sleep [58, 115, 137, 138], A 
broader role for the amygdala in regulating sleep-wake behavior is suggested by 
the report that functional inactivation of the CNA, including fibers of passage 
from the basolateral nucleus of the amygdala (BLA), during the dark period 
shortened sleep latency, increased NREM time, and decreased activity in rats 
[139], Bilateral electrolytic and chemical lesions of the BLA have been shown 
to increase NREM and total sleep time in rats [140], In contrast, electrical and 
chemical stimulation of the BLA increased low-voltage, high-frequency activ¬ 
ity in the cortical EEG and decreased NREM and total sleep time, respectively 
[140, 141], A more complex role for the BLA in regulating sleep-wake behavior 
was suggested by the early report that electrical stimulation of its dorsal and 
ventral regions desynchronized and synchronized the EEG, respectively [142], 
In Rhesus monkeys, bilateral chemical lesions of the amygdala produced more 
consolidated sleep [143], 

Single-cell recordings from amygdalar neurons in chronically implanted 
animals have provided additional evidence for an amygdalar contribution to 
behavioral state control. In freely behaving cats and rats, neurons in the lateral 
nucleus of the amygdala (LA) had little spontaneous activity, but a significant 
minority fired more rapidly during sleep than during wakefulness, and firing 
was generally higher in REM compared to NREM [144-146], In chronically 
implanted cats, neurons in the LA showed little spontaneous activity, but a 
small number transiently increased their firing when the animal was presented 
with a complex sensory stimulus [147]; LA neurons were more responsive to an¬ 
tidromic stimulation during sleep compared to waking, suggesting to the inves¬ 
tigators that the LA is controlled differently from the thalamocortical system 
[147]; projection neurons in the BLA behaved similarly, firing at a higher rate 
and displaying greater antidromic responsiveness during sleep than in wakeful¬ 
ness [148], 

Jha et al. [118] studied the state-related activity of CNA neurons in chroni¬ 
cally implanted rats and found that half had firing patterns related to sleep-wake 
states. Different from the LA and the BLA, the CNA contained a significant 
population of neurons that fired at the highest frequency during wakefulness 
or both wakefulness and REM; other CNA neurons fired in relation to REM 
or NREM. In one study in cats, CNA neurons had a higher spontaneous dis¬ 
charge rate in both REM and wakefulness compared to NREM [149], This 
finding is consistent with human neuroimaging data showing amygdalar activa¬ 
tion during REM [150], 

The neurocircuitry that forms the substrate for the amygdalar modulation 
of sleep-wake control has been well described. The CNA is the source of the 
major amygdalar outputs to sleep-related brainstem structures, and there are 
reciprocal connections between the CNA and the basal forebrain, which par¬ 
ticipates in the control of wakefulness [17]. There are also reciprocal connec¬ 
tions between the CNA and pontine cell groups that have long been implicated 
in sleep-wake regulation (reviewed in [116]). The medial nucleus of the amyg¬ 
dala projects directly, and via hypothalamic relays, to the ventrolateral preoptic 
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nucleus of the hypothalamus, which has been proposed to function as a “sleep 
switch” [151, 152], Interestingly, and of particular relevance to this review, it is 
also the medial nucleus of the amygdala that provides a heavy projection to the 
DRN in the rat [153], 

There is a steadily enlarging literature on 5-HT mechanisms in the amygdala 
that modulate behavioral state control and arousal level. As an example, us¬ 
ing positron emission tomography and functional magnetic resonance imaging 
in humans, Fisher et al. [154] provided evidence that amygdalar reactivity, an 
essential determinant of physiological and behavioral arousal, is in part regu¬ 
lated by 5-HT availability. In the following, we first review the neurocircuitry 
that underlies serotonergic actions in the amygdala; the localization of 5-HT 
in the different amygdalar nuclei; and the data on 5-HT receptor subtypes in 
these nuclei. We then discuss electrophysiological investigations of serotonergic 
effects on the firing of BLA and CNA neurons. With this background, we then 
suggest how 5-HT acting in the amygdala could produce the behavioral effects 
that have been reported. 

There are significant differences among the amygdalar nuclei in the extent of 
their 5-HT innervation, which arrives primarily from DRN [155-160], There is 
a heavy 5-HT innervation of the rostral and medial basal nucleus, and of the 
LA [160], In the rat, there is minimal 5-HT innervation of the CNA and the 
medial nucleus, but the macaque has a high density of 5-HT processes in the 
lateral region of the CNA, with a lower density more medially in this structure 
and in the medial amygdala [160-162], The amygdalohippocampal area, the 
intercalated nuclei, and the paralaminar nucleus of the macaque amygdala also 
have a considerable serotonergic innervation [161, 162], There is only a low 
density of 5-HT 1A receptors in the rat BLA, but a greater number in the CNA 
[163] with both principal neurons and GABAergic interneurons containing this 
receptor subtype [164], Cell bodies and processes of non-pyramidal neurons in 
the BLA, the dorsolateral LA, and other regions of the rat amygdala show im- 
munolabeling for 5-HT 2A receptors [165], and there is also recent evidence for 
5-HT 2A receptors on principal projection neurons in the rat BLA [166], BLA of 
the rat amygdala also shows a high level of binding for 5-HT 3 receptors, and 
nearly all of the receptor-positive neurons were GABAergic, presumably GA¬ 
BAergic intemeurons [167], The bed nucleus of the stria terminalis (BNST), 
thought to be a part of the so-called extended amygdala [168], has a large 5-HT 
input, and neurons in the BNST are largely inhibited by 5-HT via a 5-HT 1A 
receptor mechanism [169], The functional consequences of this inhibition are 
not yet understood. 

Elucidating the neurocircuitry underlying the participation of 5-HT in the 
amygdalar modulation of arousal and sleep-wake behavior depends on iden¬ 
tifying the cell types in which electrophysiological effects of 5-HT application 
are observed. In the rat BLA, 5-HT appears to inhibit projection neurons in¬ 
directly, via an activation of postsynaptic 5-HT 2 and 5-HT 3 receptors on in¬ 
hibitory intemeurons ([163, 170, 171], It is thought that 5-HT also inhibits a 
minority of these projection neurons by a direct, 5-HT 1A receptor-mediated ac- 
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tion [163], However, complicating this view of 5-HT transmission in the rat 
BLA is the finding that 5-HT, via a G protein-coupled 5-HT 1A receptor mech¬ 
anism, reduces the frequency of miniature inhibitory postsynaptic currents in 
a preparation of mechanically dissociated neurons [172, 173], Similarly, in the 
urethane-anesthetized rat, iontophoretic injection of a 5-HT 1A agonist inhib¬ 
ited all recorded neurons thought to be interneurons and had a variable ef¬ 
fect on neurons presumed to be projection neurons [171]. In accord with these 
physiological observations is the study (described above) reporting that 5-HT 1A 
receptors, which are thought to mediate hyperpolarization, are located on GA- 
BAergic intemeurons, as well as principal neurons, in the rat amygdala [164], 
Therefore, one must conclude that the overall effect of 5-HT 1A receptor activa¬ 
tion in BLA could be to diminish or enhance the output of this region to its 
target structures, including amygdalar areas located more medially. Recently, 
Huang et al. [174] observed, in a mouse slice preparation, that 5-HT depressed 
synaptic transmission in BLA neurons (measured as a field potential produced 
by LA stimulation and reflecting monosynaptic glutamatergic transmission) 
via a 5-HT 1A receptor mechanism for 30-50 min, before long-lasting facilita¬ 
tion through the 5-HT 4 receptor developed. Analogous results pertaining to the 
5-HT 1A receptor subtype previously were reported in the rat [175], 

Recording from CNA neurons in the freely behaving rat, Jha et al. [118] 
found that all neurons that fired selectively during REM (REM-on neurons) 
were inhibited by electrical stimulation of the DRN (Tab. 1). Other types of 
cells were unaffected. This observation complemented the earlier report of San¬ 
ford et al. [96] that 5-HT infused into the amygdala of the rat during REM led 
to short-latency changes in behavioral state but that comparable injections dur¬ 
ing NREM were ineffective (Fig. 2). It was hypothesized that REM-on neurons 
in the CNA could serve as “sentinels,” informing REM maintenance systems 
that 5-HT “tone” is high, and incompatible with REM continuance [118]. 

Gao et al. [176] have proposed another mechanism for amygdalar involve¬ 
ment in the modulation of sleep-wake behavior by 5-HT. Recalling that the 
level of 5-HT is higher in the amygdala during wakefulness compared to sleep 
[177], that a 5-HT 1A agonist disinhibits BLA principal neurons [172, 173], and 
that the activation of BLA neurons increases wakefulness [140], they suggested 
that the increase in sleep produced, after several days, by destroying the DRN 
or interfering with 5-HT synthesis depends on the inhibition of BLA neurons. 
Additional evidence that the antagonism of 5-HT “tone” in the amygdala could 
enhance sleep drive in the rat was provided by the observation of Sanford et al. 
[96] that the nonspecific 5-HT antagonist methysergide injected into the amyg¬ 
dala increased total sleep time. 

We can conclude that the amygdala, and the CNA in particular, plays an 
important role in arousal and in related attentional processes. Given the cur¬ 
rent conception of REM as a sleep state characterized paradoxically as one 
of heightened alerting to endogenous stimuli, it is not surprising that several 
studies have provided evidence that CNA activation also promotes REM and 
its phasic components. A drug microinjection study and single-cell recordings, 
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Table 1 Effects of electrical stimulation (1 Hz, 200 gs, 200 mA) of the DRN on neurons 
located in CNA. Electrical stimulation of DRN suppressed firing in REM-on neurons, 
but did not significantly affect firing in other classes of neurons with state-related acti¬ 
vity; W, waking. Reprinted with permission from [118]. 


Nnmmer of spikes during pre and post-stimulation periods 

Neurons 

Mean (±S.E.M) 
number of spikes 
during pre-stimu¬ 
lation period (75 
ms period prior to 
stimulus artifact 

Mean (±S.E.M) 
number of spikes 
during post-stimula¬ 
tion period up to 75 
ms after stimulation 

artifact 

Mean (±S.E.M) 
number of spikes 
75-175 ms follow¬ 
ing stimulation 

W-related neurons 

5.50±1.13 

4.44±1.13 

5.66±1.23 

W/REM related neurons 

8.00+1.41 

5.00±1.00 

7.00±1.41 

REM-ON neurons 

10.50±1.03 

1.50±1.03* 

12.25±1.37 

REM-suppressed neurons 

6.20+0.54 

5.60±0.54 

4.60±0.50 

NREM-related neurons 

5.66±0.94 

5.00±0.94 

6.33±0.88 


* Significantly different at p< 0.001 


both in rats, suggest that 5-HT acts in the CNA to inhibit REM. Perhaps be¬ 
cause of the evidence for a relatively light 5-HT innervation of the CNA in 
the rat, little work has been done to elucidate the responsible 5-HT receptor 
subtype(s). Single-cell studies have provided evidence that BLA, as well as the 
CNA, participates in behavioral state control. However, there is not yet an ex¬ 
planation of how, given that both LA and BLA neurons show heightened ac¬ 
tivity during sleep compared to waking, lesioning the BLA increases NREM 
and total sleep time and how stimulation of the BLA has the opposite effect. 
The resolution of this apparent discrepancy may in part depend on ablation 
and stimulation studies that target particular subregions of BLA. 

Although BLA has a heavy 5-HT innervation, and although there is support 
specifically for the suggestion that the sleep-promoting effect of 5-HT antago¬ 
nism or depletion has a BLA substrate, the precise pathways and mechanisms 
of this effect require delineation. Given what is currently known of amygdalar 
anatomy, physiology, and 5-HT receptor subtype distribution, one might hy¬ 
pothesize that the withdrawal of 5-HT input reduces the inhibition of BLA 
projection neurons that is otherwise mediated by excitatory 5-HT 2 and 5-HT 3 
receptors on GABAergic interneurons. Sleep enhancement could then be un¬ 
derstood in the context of the proposal of Pare et al. [178] that LA neuron 
activation facilitates medial CNA output to brainstem regions, including the 
pontine reticular formation and the nucleus of the solitary tract, the latter im¬ 
plicated in NREM generation [150], 
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Fig. 2 Percentage of microinjections into central nucleus of the amygdala (CNA) during 
REM and NREM producing a change of state. The data are graphed cumulatively across 
time and demonstrate the dramatic state-changing effect of 5-HT microinjections admi¬ 
nistered in REM compared to 5-HT injections administered in NREM or saline(SAL) 
injection in either REM or NREM. Reprinted with permission from [96] 


Conclusion 

Considerable evidence implicates 5-HT in the regulation of the brainstem alert¬ 
ing system, both in wakefulness and in REM. Local application of serotoner¬ 
gic agents into REM and PGO wave regulatory regions in the brainstem can 
alter REM, but there is conflicting evidence as to whether these manipulations 
can independently influence PGO wave generation. A potential site of action 
of 5-HT is the amygdala, which plays a role in regulating arousal as well as 
in regulating neurobiological responses to novel and significant stimuli, and 
which can influence the occurrence and amplitude of PGO waves, in our view, 
a brainstem marker of alerting. 
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Abstract 

Serotonergic neurons in the midbrain and medulla are sensitive to changes in serum C0 2 
concentrations. Medullary serotonergic neurons project to brainstem respiratory control 
centers and stimulate breathing. Midbrain serotonergic neurons project to thalamocortical 
circuitry responsible for sleep-wake modulation. There is state-dependent modulation of 
these medullary serotonergic neurons that may be responsible for state-dependent changes 
in respiratory rate and breathing regularity. Thus, with projections to both respiratory con¬ 
trol centers and thalamocortical arousal circuits, chemosensitive serotonergic neurons are 
poised to induce both arousal and increased ventilation in response to potentially life- 
threatening increases in PC0 2 . This may have important implications for such clinical 
conditions as sudden infant death syndrome, obstructive sleep apnea, and panic disorder; 
disorders in which serotonin is thought to contribute to the underlying pathophysiology. 


Introduction 

Breathing serves the important function of ensuring oxygenation of the body’s 
tissues, and equally importantly controls blood PC0 2 to maintain a serum pH 
conducive to optimal functioning of these tissues. In recent years, there has 
been an increased appreciation of the role that serotonergic neurons from the 
raphe nuclei play in control of breathing. Serotonergic neurons in the medulla 
project to brainstem respiratory control centers and stimulate breathing. There 
is state-dependent modulation of these medullary serotonergic neurons that 
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may be responsible for state-dependent changes in respiratory rate and breath¬ 
ing regularity [1, 2 \. A growing body of evidence also implicates serotonergic 
neurons as central chemoreceptors that sense changes in brain tissue pH resul¬ 
tant from perturbations in the partial pressure of arterial C0 2 (PC0 2 ) [3], This 
chemosensitivity is a property that is shared with serotonergic neurons of the 
midbrain. Thus, with projections to both respiratory control centers and thala¬ 
mocortical arousal circuits, chemosensitive serotonergic neurons are poised to 
induce both arousal and increased ventilation in response to potentially life- 
threatening increases in PC0 2 (Fig. 1). The focus of this chapter is the potential 
role of chemosensitive serotonergic neurons in mediating interactions between 
the respiratory and sleep-wake systems. This may have important implications 
for such clinical conditions as sudden infant death syndrome (SIDS), obstruc¬ 
tive sleep apnea (OSA), and panic disorder. 



Midbrain 

5-HT 

Neurons 


Medullary 

5-HT 

Neurons 


Fig. 1 Schematic depicting the proposed model by which serotonergic neurons mediate 
ventilatory and vigilance state changes in response to changes in C0 2 /pH (AC0 2 /ApH). 
Increased C0 2 (due to rebreathing, airway obstruction or apnea) leads to decreased pH 
and activation of midbrain serotonergic neurons. These neurons in turn activate tha¬ 
lamocortical circuitry resulting in an elevation of arousal state. Increased C0 2 also leads 
to activation of medullary serotonergic neurons, which stimulate respiratory nuclei to 
increase ventilation. Both of these pathways serve to restore C0 2 homeostasis. 5-HT, 
serotonin 
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The role of serotonin in breathing 

There is strong evidence that serotonin (5-HT), and/or serotonergic neurons 
play two major roles in the control of breathing by both providing tonic drive 
to respiratory neurons and acting as central respiratory C0 2 /pH chemorecep- 
tors. The distinction between these two influences on respiratory control lies in 
the post-synaptic neuromodulatory actions of 5-HT versus the intrinsic mem¬ 
brane properties of the neurons that produce 5-HT. 

There is a high density of 5-HT-immunoreactive (5-HT-ir) synaptic termi¬ 
nals in respiratory nuclei, including the nucleus of the solitary tract (NTS), pre- 
Botzinger complex (preBotzC), nucleus ambiguus, and phrenic and hypoglossal 
motor nuclei [4-12], These 5-HT-ir projections arise from the medullary sero¬ 
tonergic neuron populations [5, 6, 8, 13-17], Several 5-HT receptor subtypes 
have been found within respiratory nuclei. There are 5-HT 1A and 5-HT 1B recep¬ 
tors in the NTS and hypoglossal nuclei [18], 5-HT 4A receptors in the respiratory 
rhythm-generating pre-BotzC [19, 20], and 5-HT 2A receptors in the hypoglossal 
nucleus and nucleus ambiguous [19], 

The implications from anatomic observations couple well with the results 
from physiological studies, although it was long debated whether serotonin 
stimulates or inhibits breathing based on conflicting results from several stud¬ 
ies [21-27], Improvements in pharmacological agents and experimental tech¬ 
niques have since allowed for more evidence that the primary effect of 5-HT is 
to stimulate breathing. For example, electrical stimulation of the medullary ra¬ 
phe increases 5-HT release in both the NTS and phrenic motor nucleus [28] and 
increases ventilation [13], Microinjection of the nonselective 5-HT receptor an¬ 
tagonist methysergide into the phrenic motor nucleus attenuates the respiratory 
facilitation evoked with electrical stimulation of raphe pallidus [13], The 5-HT 1A 
agonists buspirone and 8-hydroxy-dipropylaminotetralin (8-OH-DPAT), the 
5-HT 2A/2C agonist (±)-4-iodo-2,5-dimethoxyamphetamine (DOI), and the 
5-HT 4A agonist (endo-N-8-methyl-8-azabicyclo[3.2.1] oct-3-yl)-2,3-dihydro-3- 
isopropyl-2-oxo-lH-benzimidazol-l-carboxamide hydrochloride (BIMU8) can 
all stimulate breathing in vivo [20, 29-34], Respiratory depression elicited by 
opiates can be reversed in rats in vivo by 8-OH-DPAT, buspirone and BIMU8 
[20, 35] (Fig. 2). Bath application of 5-HT or DOI to the neonatal rat in vitro 
brainstem spinal cord preparation [36] usually causes an increase in frequency 
of rhythmic phrenic nerve output, often with tonic firing of phrenic motor neu¬ 
rons [37^10], In the in vitro medullary brain slice, the preBotzC spontaneously 
generates respiratory activity in the hypoglossal nerve [41], This spontaneous 
activity can be augmented by the serotonin selective reuptake inhibitor (SSRI), 
alaproclate, and DOI, and it is blocked by the 5HT 2A receptor antagonist, ket- 
anserin [42] (Fig. 2). The neuropeptides substance P and thyrotropin releasing 
hormone, which are co-localized in many 5-HT neurons, also stimulate breath¬ 
ing in vivo [43, 44], and induce bursting activity in respiratory neurons in vitro 
[42,45], Thus, it is clear from physiology experiments that 5-HT neurons stimu¬ 
late breathing at both the pre-motor and motor neuron levels. 
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◄ Fig. 2 5-HT stimulates respiration in vitro and in vivo, (a) Top: In vivo tracing of 
respiratory airflow in a spontaneously breathing, anesthetized rat. Middle: Fentanyl in¬ 
duces a significant reduction in respiratory minute volume. Bottom: BIMU8 reverses 
the fentanyl-induced respiratory depression. Asterisks denote transient periods of ar¬ 
tificial respiration, needed to prevent death. Exp, expiration; Insp, inspiration, (b) In 
vitro extracellular integrated population recording from preBotC neurons within mouse 
brainstem slices demonstrating smaller amplitude bursts representing fictive respirato¬ 
ry activity and large amplitude bursts representing fictive sighs. Both types of activity 
increase following application of the 5-HT 2A agonist DOI in vitro, (c) In vitro integrated 
population recording from the same preparation as in (b) demonstrating decrease in 
firing rate, amplitude and regularity of respiratory activity following treatment with the 
5-HT 2A antagonist ketanserin. (a) adapted with permission from [20], (b) and (c) adapted 
with permission from [42] 


State-dependent respiratory modulation 

Many changes occur in the regulation of breathing as transitions are made 
though various vigilance states. At the transition from wakefulness to light 
NREM, there can be breathing instability [46, 47] termed periodic breathing, 
or Cheyne-Stokes respiration [48], The instability of breathing at its extreme 
can manifest as obstructive, central or mixed apneas [49], In deeper NREM 
breathing is more regular with generally slow respiratory rate and increased 
tidal volume. 

Accompanying these changes is a relative increase in the partial pressure of 
C0 2 in arterial blood and a concomitant decrease in the arterial partial pressure 
of 0 2 . Total airway resistance is increased in NREM due largely to a decrease 
in tonic activity to upper airway muscles, leading to an increase in upper air¬ 
way resistance [50-52], Intercostal muscle activity is increased during NREM 
as evidenced by EMG studies with little or no increase in diaphragmatic muscle 
activity [53, 54], The state-dependent control of upper airway tone is medi¬ 
ated in part by 5-HT. Activation of 5-HT 1A , 5-HT 2A and 5-HT 2C receptors in¬ 
creases upper airway tone [55, 56], Decreased 5-HT neuronal firing in the raphe 
pallidus is associated with decreased firing in respiratory motor neurons and 
a subsequent decrease in upper airway tone [1, 57, 58], Given evidence that 
generation of bursting in respiratory neurons is dependent upon serotonergic 
input [42, 59], decreasing 5-HT neuronal firing during sleep and subsequently 
decreased serotonergic input to respiratory centers could in part account for 
state-dependent changes in ventilation. 

Respiration is profoundly irregular in REM sleep [46, 60] and is associated 
with sudden changes in respiratory frequency and amplitude. Furthermore, 
there can be apneic intrusions lasting 10-30 s or more. The breathing irregu¬ 
larities seen in REM sleep are closely linked to the occurrence of characteristic 
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bursts of REM [61, 62], Studies have been inconsistent in determining changes 
in minute ventilation in REM compared to NREM sleep due largely to techni¬ 
cal difficulties in measuring airway and breathing parameters in episodes of 
REM due in part to their short duration. There appears to be a decreased con¬ 
tribution of rib cage musculature to breathing in REM compared to NREM 
sleep [63] with a relative increase in diaphragmatic activity [54, 64], This is likely 
related to inhibition of alpha motoneurons and fusimotor function driving in¬ 
tercostal muscle tone [65], but given the relative paucity of fusimotor innerva¬ 
tion the diaphragm is relatively unaffected [66], 

Small changes in inspired C0 2 induce changes in ventilation [67-70] with a 
linear relationship between C0 2 concentration and ventilatory rate. Increases 



P A C0 2 

Fig. 3 Sleep state-dependence of C0 2 sensitivity in humans. The slope of the ventilatory 
response curve to alveolar 0O 2 (P 4 C0 2 ) decreases as deeper levels of sleep are achieved. 
Adapted with permission from [71] 
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in C0 2 lead to increased ventilation, whereas a decrease in C0 2 level can induce 
apneas [49], This ventilatory response to C0 2 is sleep state dependent, where 
C0 2 sensitivity is attenuated during NREM sleep [71, 72] (Fig. 3). 

The overriding goal of respiratory modifications during sleep is to main¬ 
tain C0 2 /pH homeostasis to preserve respiratory drive and ensure appropriate 
oxygen availability. The rules regarding C0 2 homeostasis may differ somewhat 
between vigilance states, but the general goal is to maintain homeostasis. It has 
been postulated that there may be vigilance state-dependent set points for C0 2 . 
As one falls asleep, minute ventilation decreases and allows the C0 2 level to rise 
to the sleep set point, which is higher than that for wakefulness. During brief 
arousals from sleep there is an increase in ventilation that serves to bring the 
C0 2 level back down to the wakefulness set point [73], During sleep there is a 
decrease in sensitivity of the C0 2 controller in that much higher concentrations 
of C0 2 are required to induce a small increase in ventilation [71]. As seen be¬ 
low, a very similar state dependence is seen for C0 2 -induced arousal. 


Role of serotonin in arousal 

Transitions between vigilance states are mediated through intricate thalamo¬ 
cortical circuits [74, 75], These circuits generate the oscillations that are charac¬ 
teristic of delta waves in slow wave sleep (SWS), as well as the desynchronized 
activity of wakefulness, and the sleep spindles seen in light sleep [74, 75], 5-HT 
promotes the conversion of thalamocortical activity from a bursting (NREM) 
pattern to a tonic (waking) pattern. This is mediated via depolarization of GA- 
BAergic reticular and perigeniculate neurons [76-78] and modulation of the 
hyperpolarization-activated cation current thereby creating a state of excitabil¬ 
ity conducive to conscious thought [79, 80], Other neurotransmitters, including 
acetylcholine, histamine, norepinephrine, glutamate, and adenosine, can also 
modulate this circuitry in a similar way [74], 

Sleep-wake homeostasis is maintained by interconnections between the 
brainstem and above-mentioned thalamocortical circuitry. This homeosta¬ 
sis is modulated by pressures for sleep and for waking, the circadian system, 
and exogenous stimuli [81]. The brainstem ascending arousal system (AAS) 
is intimately involved with maintenance of this homeostasis [82], The AAS is 
composed of a cholinergic dorsal arm and a monoaminergic ventral arm [83], 
The monoaminergic neurons involved with the ventral arm include noradren¬ 
ergic neurons from the locus coeruleus [84], dopaminergic neurons from the 
periaqueductal gray [85], histaminergic neurons from the tuberomammillary 
nucleus [86], and serotonergic neurons from the dorsal and median raphe nu¬ 
clei [87, 88], Other than dopaminergic neurons, these monoaminergic neurons 
universally fire with the fastest rate during wakefulness, decrease firing during 
NREM, and become almost silent during REM [1, 2, 89, 90], 
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Monoaminergic cells are in turn modulated by two primary cell groups: 
orexin-containing neurons in the lateral hypothalamus and GABAergic neu¬ 
rons in the ventrolateral preoptic (YLPO) nucleus [85], Orexin-containing neu¬ 
rons are similar to monoaminergic neurons in that they also fire fastest during 
wakefulness [91]. They induce an increase in firing of neurons within the locus 
coeruleus [92], tuberomammillary nucleus [93], and dorsal raphe [94] via release 
of orexin and the excitatory neurotransmitter, glutamate [95], Neurons within 
the VLPO are most active during sleep [96-98], and induce a decrease in firing 
of locus coeruleus, tuberomammillary, and dorsal raphe neurons [99], They are 
in turn inhibited by noradrenergic and serotonergic inputs from the locus coe¬ 
ruleus and dorsal raphe nuclei, respectively [100, 101]. 

Microdialysis studies show that 5-HT concentrations in the cat dorsal ra¬ 
phe nucleus [102, 103], rat hippocampus [104], rat pedunculopontine tegmental 
nucleus [105], and human lateral ventricles [106] are highest during wakefulness 
and progressively decline in NREM and REM. 5-HT receptor availability is 
increased during sleep in humans, suggesting decreased 5-HT binding and de¬ 
creased 5-HT levels [107], 

5-HT receptors are present in many brain regions involved with regulation 
of sleep-wakefulness. Subcutaneous injection of the 5-HT 1A receptor agonists, 
8-OH-DPAT [108, 109], RU24969 [108], and ipsapirone [110], promote wake¬ 
fulness in rats. 8-OH-DPAT application to the nucleus paragigantocellularis 
lateralis in piglets results in sleep fragmentation with an increased proportion 
of waking and a decreased proportion of REM. This also increases the number 
of bouts of NREM but decreases the duration of the bouts with no resultant 
change in the proportion of time in NREM [111]. Ipsapirone inhibits REM 
sleep in humans [112], rats [110], and cats [113]. In at least one study, this effect 
is via inhibition of mesopontine cholinergic nuclei that are active during REM 
[113]. In another study the REM inhibitory effect of ipsapirone persists after 
destruction of 5-HT neurons within the dorsal raphe nucleus (DRN), suggest¬ 
ing that the effect is not due to inhibition of 5-HT neurons by 5-HT 1A auto¬ 
receptors [110]. The non-selective 5-HT 2 receptor agonist l-(2,5-dimethoxy- 
4-methylphenyl)-2-amipropane (DOM) [114], and the 5-HT 2A/2C agonist DOI 
[115] both decrease SWS in rats. DOI also increases wakefulness in rats [115]. 
This effect is inhibited by a 5-HT 2A antagonist but not a 5-HT 2C antagonist 
[115]. 5-HT 2A/2C antagonists increase SWS [109, 114, 116-118], SSRIs suppress 
REM sleep in rats [119], cats [120] and humans [121], 

Data from transgenic mice also supports a role for serotonin in modulat¬ 
ing sleep-wake homeostasis. 5-HT 1B and 5-HT 2A receptor-knockout mice have 
less NREM sleep [122, 123], 5-HT 1B -knockouts also have an increase in REM 
sleep, but do not demonstrate an increase in REM following sleep deprivation 
[122], 5-HT 2C receptor-knockout mice spend a larger percentage of time in the 
waking state and show an exaggerated increase in REM sleep following sleep 
deprivation [124], 
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Serotonergic neurons are central respiratory chemoreceptors 


Minute-to-minute alterations in blood and/or tissue levels of P0 2 , PC0 2 and 
pH lead to adjustments in ventilatory output aiming to restore blood gas and 
pH homeostasis. Despite recent evidence of central 0 2 chemoreceptors [125], 
it is still accepted that under physiological conditions oxygen levels are prima¬ 
rily sensed peripherally by the carotid bodies [126], In addition to sensitivity 
to 0 2 , carotid sinus nerve activity is also altered by PC0 2 and pH [126, 127], 
The carotid body contribution to the C0 2 response represents approximately 
one-third of the overall C0 2 response, whereas the majority of the response is 
central in origin relying upon C0 2 -sensitive neurons within brainstem nuclei 
[127-131], The site(s) and neuronal cell types that are responsible for central 
respiratory chemoreception have been the source of recent controversy and in¬ 
tense investigation [132, 133], 

There are neurons in a number of brainstem nuclei that have properties con¬ 
sistent with being chemoreceptors, including the NTS [134], locus coeruleus 
[135], and retro trapezoid nucleus [136], Among the candidates for central respi¬ 
ratory C0 2 chemoreceptors, serotonergic neurons in the medullary raphe have 
been implicated by the largest variety of in vitro and in vivo data [3, 137-141], 
It was first noted that a subset (-15%) of raphe neurons in primary cell culture 
and neonatal brainstem slices from rats dramatically increase their firing rate 
(-300%) in response to a decrease in pH from 7.4 to 7.2 [140, 142] (Fig. 4). 
Additionally, the increased activity is an intrinsic property of these cells, as the 
addition of glutamate receptor antagonists, 6-cyano-7-nitroquinoxaline-2,3- 
dione (CNQX) and DL-2-amino-5-phosphonovalerate (APV), and the GABA 
receptor antagonist, picrotoxin, as well as physical isolation of these cells does 
not prevent the response to acidosis. All of the acidosis-stimulated neurons 
from the rat medullary raphe are 5-HT-ir [143], Preliminary data from mice 
that express yellow fluorescent protein in serotonergic neurons [144] indicate 
that there is a high degree of C0 2 sensitivity in acutely dissociated cells, con¬ 
firming that the response is intrinsic, and indicating that chemosensitivity is a 
property of 5-HT neurons shared in other mammals (Hodges and Richerson, 
unpublished observations). Finally, a high percentage of acidosis-stimulated 
rat midbrain neurons are also serotonergic, giving rise to the hypothesis that se¬ 
rotonergic neurons may be relatively homogeneous in their response to C0 2 /pH 
[145], However, it remains unclear if intrinsic C0 2 sensitivity is a ubiquitous 
characteristic of all serotonergic neurons, or if this is only a property of a spe¬ 
cific subset of 5-HT neurons. 

5-HT neurons have an intriguing relationship with large penetrating brain¬ 
stem arteries. The rodent medulla receives its primary blood supply from 
branches of the basilar artery, which penetrate the parenchyma at the ven¬ 
tral midline and ventrolateral medullary surfaces. An unusual feature of the 
mid-sagittal brainstem is the relative abundance of arterial blood supply with 
a paucity of large veins [146], 5-HT neurons are distributed throughout both 
of these regions, often in close apposition to the local vasculature. In fact, the 
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Fig. 4 5-HT neurons act as central chemoreceptors. (a) Patch-clamp recording from a 
dorsal raphe neuron in a rat brain slice demonstrating an increase in firing rate in re¬ 
sponse to decreased pH. (b) Confocal image of the neuron in (a). The biocytin-injected 
neuron (green) is in close apposition to the smooth-muscle a-actin immunostained arte¬ 
ry (red). Scale bar, 50 pm. (c) Confocal image of a transverse rat midbrain slice after ar¬ 
terial injection of fluorescent albumin (red) and immunostaining for tryptophan hydro¬ 
xylase (TPH) (green). Depicted here is the caudal portion of the dorsal raphe. Note the 
large arteries that run along the borders of the raphe. Scale bar, 50 pm. (d) Patch-clamp 
recording from a medullary raphe neuron in a rat brain slice demonstrating an increase 
in firing rate in response to a decrease in pH. (e) Confocal image of the neuron (green) 
in (d) demonstrating close apposition to arteries (red). TPH-immunoreactive neurons 
are depicted in blue. Staining otherwise as in (b). P, pyramidal tract; scale bar, 50 pm. (f) 
Confocal image of the ventral medullary surface en bloc. Staining as in (c). Note that 
the regions with the highest concentrations of Scale bar, 1.5 mm. (a-c) Adapted with 
permission from [145], (d-f) Adapted with permission from [146] 



























Chemosensitive 5-HT neurons, breathing and arousal 


539 


highest concentrations of serotonergic neurons are located near the largest of 
the penetrating arteries, with their processes wrapping around and enveloping 
nearby arteries. Electron micrographs show that these 5-HT neuron processes 
are sometimes located within 0.5-2.0 pm of the vessel lumen. Electrophysio- 
logical recordings in brainstem slices reveal that 5-HT neurons near arteries 
are also C0 2 sensitive. The intimate relationship of 5-HT somata and processes 
and large arteries in a region rich in arterial blood supply may be an example 
of “form follows function,” where 5-HT neurons are ideally situated to monitor 
the effectiveness of pulmonary gas exchange. 

It is noteworthy that at early postnatal ages, 5-HT neurons have decreased 
sensitivity to C0 2 /pH. Acidosis-stimulated, serotonergic raphe neurons from 
both primary cell cultures and brainstem slices are much less sensitive to hy¬ 
percapnic acidosis until postnatal days 10-12 [147]. However, after postnatal 
day 12 (P12) the CO z /pH sensitivity of 5-HT neurons steadily increases up to 
PI8-24, and then remains high up to 90 days in culture. The C0 2 response of 
neonatal rats in vivo follows a similar pattern of development, where prior to 
P10 there is only a small increase in breathing in response to inspired C0 2 , and 
thereafter there is a steady increase in the ventilatory response to inspired C0 2 
until approximately P20 [148-150], This parallel in the development of intrinsic 
C0 2 sensitivity of 5-HT neurons and the ventilatory response to C0 2 in vivo 
provides further support for the conclusion that 5-HT-producing neurons act 
as C0 2 /pH chemoreceptors. 

The hypothesis that 5-HT neurons are central respiratory chemoreceptors 
is further supported by in vivo experiments. A subset of electrophysiologically 
identified serotonergic neurons increase their firing rate in response to inhaled 
C0 2 during extracellullar recordings in awake, behaving cats [141] (Fig. 5). In¬ 
halation of air with elevated C0 2 also increases c-fos staining in neurons of 
the medullary raphe [151], including neurons that are serotonergic [152-154], 
These observations are significant in part because serotonergic neurons are re¬ 
markably unaffected by most other afferent inputs. They usually fire monoto¬ 
nously, the major exception being that they decrease their firing rate during 
sleep and increase firing with an increase in motor activity [9], Additionally, 
microinjection of acetazolamide [155], or reverse microdialysis of a high C0 2 
solution into the medullary raphe, both of which induce focal acidosis, causes 
an increase in breathing [137, 138], 

After neonatal rats are treated with the 5-HT neuron-specific toxin 5,7-di- 
hydroxytryptamine (5,7-DHT) and are allowed to grow to adulthood, their 
baseline blood C0 2 level is elevated and their ventilatory response to C0 2 is 
blunted [156, 157], The ventilatory response of piglets to C0 2 inhalation is also 
reduced after microinjections of lidocaine, ibotenic acid or muscimol into the 
medullary raphe [158, 159], Medullary raphe lesions induced by ibotenic acid 
lead to transient hypoventilation and decreased C0 2 sensitivity 3-7 days after 
injection [160], In addition, acute inhibition of medullary serotonergic neurons 
by focal injection of 8-OH-DPAT into the raphe [161] and lesions of medullary 
serotonergic neurons with focal injections of saporin conjugated to an anti¬ 
body against the 5-HT transporter [139] causes depression of the ventilatory 
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Fig. 5 State-dependent decrease in C0 2 sensitivity of a caudal raphe neuron in a freely 
moving cat. Graph of the response of a single 5-HT neuron to hypercapnia in slow 
wave sleep (SWS) (closed circles) compared to quiet waking (open circles). Adapted with 
permission from [141] 


response to C0 2 . Finally, in the in situ perfused rat brain preparation, methy- 
sergide disrupts normal breathing and blunts the increase in phrenic nerve out¬ 
put that normally occurs in response to an increase in perfusate PC0 2 [162], 
Recent data from our laboratory utilizing genetically altered mice further 
supports the concept that 5-HT neurons act as central CO z chemoreceptors. 
Genetic deletion of the transcription factor Pet-1, which is selectively expressed 
in all serotonergic neurons, leads to a 70% loss of 5-HT neurons [163], This 
moderate loss of 5-HT neurons had little effect on baseline breathing and the 
sensitivity to hypoxia, but led to a 36% decrease in the response to a C0 2 chal¬ 
lenge relative to wild-type mice [164], Interestingly, the observed deficit in the 
C0 2 response in Pei-7-knockout mice was seen only in males, whereas female 
Pei-7-knockout mice exhibited no deficit [164], Additional experiments are nec¬ 
essary to determine the nature of the sexual dimorphism in the C0 2 response. 
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Studies in a second mouse model also show specific effects on the CO z re¬ 
sponse. Another transcription factor, Lmxlb, plays a role in the development 
of 5-HT and other neurons. Selective deletion of Lmxlb in Pet-7-expressing 
neurons leads to a severe (>99%) and specific loss of serotonergic neurons in 
Lmxlb mir conditional knockouts [165], Interestingly, the mice are viable, and 
exhibit normal motor function despite near-complete loss of 5-HT neurons 
since early development. 

Lmxlb m conditional knockouts, relative to their wild-type counterparts, 
have a ventilatory response to high CO z in room air (21% 0 2 ) that is blunted by 
-35% with no effect on the hypoxic (10% 0 2 ) ventilatory response, pointing to 
a C0 2 -speeific deficit. Finally, exposing normal animals to high 0 2 attenuates 
the peripheral chemoreceptor response to C0 2 [166], and when this is done to 
Lmxlb m mice the response to high C0 2 is further attenuated to -50% of wild- 
type mice. The large attenuation of the C0 2 response, and the lack of an effect 
on the hypoxic ventilatory response points to a large and specific contribution 
of 5-HT neurons to central respiratory C0 2 chemoreception. 

The two described roles of 5-HT neurons in the control of breathing (tonic 
modulation and central CO z /pH chemoreception) clearly are complementary 
to each other. The neurons sense changes in PC0 2 /pH and modulate their dis¬ 
charge rate accordingly [141], This leads to increased 5-HT release and an alter¬ 
ation in the level of tonic post-synaptic excitability of both pre-motor (rhythm¬ 
generating) and motor (phrenic) neurons, thus resulting in increased ventilation 
and restoration of homeostatic levels of PC0 2 . 

As seen above, hypercapnia is a potent physiological stimulus inducing 
changes in ventilation in an attempt to restore C0 2 homeostasis. Hypercapnia 
is also a potent arousal stimulus. In adult humans hypercapnia induces arousal 
from both NREM and REM sleep in a state-dependent manner, with a much 
lower degree of hypercapnia required to induce arousal out of REM compared 
to NREM [68], In at least one study in humans, arousal occurred on average 
60-100 s after onset of the hypercapnic challenge [68], This latency is consistent 
with the long time constant for the central chemoreceptor component of the 
hypercapnic ventilatory response [167], In dogs, hyperoxic hypercapnia induces 
arousals from both NREM and REM but does so more quickly and at a lower 
C0 2 concentration in NREM than in REM [67], In lambs, repeated 60-s chal¬ 
lenges with 8% C0 2 greatly increased the arousal probability compared with a 
eucapnic environment [152] (Fig. 6). 

If 5-HT neurons in the midbrain are C0 2 /pH chemoreceptors that are im¬ 
portant for inducing arousal in response to hypercapnia [3], then it would be 
expected that a defect in 5-HT neurons would lead to impairment of the hyper¬ 
capnic arousal response. Preliminary data from Lmxlb f ® p conditional knockout 
mice indicate that this may be the case. Wild-type mice robustly aroused to 
a hypercapnic challenge with changes in both electroencephalographic power, 
consistent with heightened arousal and a qualitative increase in exploratory be¬ 
havior. Lmxlb mip mice did not demonstrate electroencephalographic or behavio¬ 
ral evidence of a change in arousal state in response to hypercapnia [168], 
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Fig. 6 C0 2 induces arousal, (a) Tracing depicting human arousal from SWS in response 
to an increase in alveolar C0 2 to ~7%. After a delay of 60-100 s after elevation of C0 2 
there is an increase in tidal volume (V T ) and arousal. Arrow denotes point of arousal. 
C0 2 , C0 2 concentration in nostrils; EMG, electromyogram; EEG, electroencephalogram, 
(b) Bar graph depicting increased waking probability in response to hypercapnic challen¬ 
ge in lambs. Asterisks denote significant difference compared to control (p<0.05). Cross 
denotes significant difference between vigilance states (p<0.001). (a) Adapted with per¬ 
mission from [68], (b) Adapted with permission from [152], 


Clinical implications 

As seen above there is strong evidence to support the theory that serotonergic 
neurons act as central chemoreceptors to sense changes in pH induced by hy¬ 
percapnia. Thus serotonergic fibers are able to modulate ventilation appropri¬ 
ately to restore C0 2 homeostasis. Given interconnections with thalamocortical 
circuitry these serotonergic neurons are also poised to translate the decreased 
pH into an elevation in arousal state. Interactions between serum C0 2 /pH, ven¬ 
tilatory changes, and arousal state changes may contribute to morbidity and 
mortality in disease entities such as SIDS and OSA, and may also underlie the 
pathophysiology of panic disorder. 


Sudden infant death syndrome 

Despite a 50% reduction in SIDS rates after the 1992 “Back to Sleep” cam¬ 
paign, SIDS remains the leading cause of post-neonatal death in the U.S oc¬ 
curring in 0.6 in every 1000 live births in the U.S., or 6 infants per day. The 
study of SIDS has been particularly difficult due to the inability to identify 
high-risk infants. SIDS affects all socioeconomic, cultural and racial groups, 
but has a greater impact on African-Americans and Native Americans. Certain 
consistent risk factors have been identified including maternal smoking, prone 
sleeping position, sleeping on soft surfaces, low birth weight and male sex [169], 
Aiming to reconcile these epidemiological data, the Triple Risk Model of SIDS 
[170] was constructed based in part on the model of Hunt and Brouillete where 
an infant with an underlying vulnerability dies when challenged with a homeo- 
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static stressor during a critical period of development [171], Since that time, 
histological findings from SIDS victims point to more specific clues, including 
abnormalities in the brainstem 5-HT system [172], These earlier findings have 
since been validated in additional data sets, and specific 5-HT abnormalities 
have been revealed. Paterson and colleagues [173] found that the number of 
5-HT neurons in the medulla is elevated in SIDS infants, although the major¬ 
ity of these neurons were granular (possibly immature) with fewer multipolar 
neurons. Additionally, both 5-HT 1A receptor binding and 5-HT transport pro¬ 
tein density were decreased. Importantly, they also found that 5-HT 1A recep¬ 
tor binding was significantly lower in male SIDS cases relative to female cases, 
which may be related to previous observations of a greater risk of SIDS in male 
infants. Although it remains to be determined if the reported dysfunction of 
the 5-HT system in SIDS cases is the primary defect, the data suggesting 5-HT 
neurons are respiratory C0 2 chemoreceptors provide a link between pathology 
and physiology. Under normal conditions hypoventilation or rebreathing, par¬ 
ticularly during sleep, may lead to increased C0 2 concentrations and increased 
serotonergic neuron activity triggering arousal, and increase respiratory drive. 
Both of these responses occur in an attempt to restore C0 2 /pH homeostasis 
(Fig. 1). Hence, dysfunction of the 5-HT system may represent the underlying 
vulnerability in SIDS, whereby rebreathing or hypoventilation during a criti¬ 
cal developmental period results in hypercapnia and hypoxia and failure to 
arouse. 


Obstructive sleep apnea 

Another disease entity in which interactions between C0 2 /pH homeostasis, 
ventilation and arousal state changes is important is OSA. Patients with OSA 
suffer from repeated (10-60 on average) apneic episodes throughout a sleep 
period in a given night, leading to excessive daytime sleepiness, higher risk of 
automobile accidents, decreased memory, erectile dysfunction, depression, hy¬ 
pertension, and increased risk of stroke and congestive heart failure [174-177], 
Approximately 4% of adults are affected by OSA [178], OSA predominantly 
affects males by as much 5-8:1 [179, 180], Both anatomic and neurophysiologi¬ 
cal factors contribute to airway obstruction in OSA. For example, obstruction 
of the soft palate can arise from enlarged fat pads compressing the upper air¬ 
way or from abnormally low upper airway tone. Decreased upper airway tone 
increases airway compliance and increases resistance at a given negative airway 
pressure. 5-HT input to upper airway dilator muscles decreases during sleep. 
The dilator motor neuron synapse utilizes 5-HT 2A and 5-HT 2C receptors post- 
synaptically and 5-HT 1A and 5-HT 1B receptors presynaptically [181]. 

Given the evidence that serotonergic neurons of the medullary raphe: (1) 
provide tonic 5-HT release at the motor nuclei driving upper airway muscular 
tone, which is reduced during sleep [182], (2) are sensitive to increased C0 2 
and decreased pH, and (3) are involved in the ascending arousal network, it 
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follows that abnormalities in 5-HT neurons could contribute to OSA. If there 
was 5-HT system dysfunction, that could lead to abnormally low motor tone 
during sleep. The resulting obstructive apnea would drive arterial PC0 2 higher. 
An abnormality of 5-HT neurons would prevent them from normally sens¬ 
ing the increased C0 2 , and there would be a failure to increase breathing and 
induce arousal to drive PC0 2 down to normal levels (Fig. 1). There is no evi¬ 
dence for a primary defect of 5-HT neurons in OSA, but it is possible that in¬ 
dividuals whose 5-HT neurons are less sensitive to C0 2 might be more suscep¬ 
tible to OSA. 


Panic disorder 

A third disease entity in which derangements in serotonergic signaling/chemo- 
reception may play a pivotal role is panic disorder [183, 184], There are exten¬ 
sive interconnections between midbrain serotonergic nuclei and limbic regions 
responsible for fear, anxiety and panic reactions [185-189], Drugs that increase 
5-HT availability, namely SSRIs, are a first-line choice for the treatment of 
panic disorder [190, 191]. This is all in support of a role for 5-HT in mediating 
panic. One theory of the pathophysiology of panic disorder is that there is a hy¬ 
persensitive “suffocation alarm” [192] whereby a small increase in blood PC0 2 
leads to physiological and behavioral changes of panic, including increased 
heart rate, palpitations, respiratory rate, dyspnea, diaphoresis, and sense of fear 
or doom [192, 193], Consistent with this, patients with panic disorder can be 
induced to have an attack by breathing air enriched with C0 2 [194, 195], The 
changes in C0 2 in this setting may be sensed abnormally by serotonergic neu¬ 
rons, which in turn activate thalamocortical mechanisms, the limbic system and 
respiratory centers to produce heightened arousal and increased respiratory 
rate seen in panic disorder. 


Summary 

As described here, there is a great deal of recent evidence to support medullary 
5-HT neurons as central C0 2 chemoreceptors that mediate changes in respira¬ 
tion to maintain C0 2 homeostasis. Serotonergic neurons in the midbrain are 
also poised to exact changes in vigilance state in response to changes in PC0 2 . 
Derangements in these physiological mechanisms may underlie the pathologi¬ 
cal processes at play in such disease entities as SIDS, OSA, and panic disor¬ 
der. Much more work is needed to truly understand the mechanisms by which 
serotonergic system dysfunction contributes to the pathophysiology in these 
entities. Gaining further insight into these disease processes will better enable 
development of improved treatment strategies to reduce the significant associ¬ 
ated morbidity and mortality. 
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Abstract 

Obstructive sleep apnea syndrome is a highly prevalent disorder, associated with numer¬ 
ous cardiovascular and neurobehavioral morbidities. A unique feature of this syndrome is 
the sleep-state dependency of upper airway collapse and obstruction. Indeed, individuals 
with obstructive sleep apnea have normal breathing while awake and only manifest air¬ 
way obstruction in sleep. This sleep-state dependency for obstruction strongly supports 
the concept that drugs targeting the neurochemical events that underlie the state-depen¬ 
dent obstruction should effectively treat obstructive sleep apnea. Tremendous progress has 
been made in understanding the neurochemical mechanisms involved in state-dependent 
control of breathing. It is apparent from this work that there are many potential avenues 
for pharmacotherapies, including several promising directions for serotonergic therapies. 
This chapter provides an update on the involvement of serotonin in breathing and in ap¬ 
neas, and then summarizes trials of serotonergic agonists and antagonists in animal mod¬ 
els and humans with obstructive sleep apnea. Future directions are suggested for success¬ 
ful development of safe and effective serotonergic pharmacotherapies for obstructive sleep 


Obstructive sleep apnea syndrome: 
clinical presentation and pathogenesis 


Obstructive sleep apnea syndrome (OSAS) is suspected in individuals with loud 
snoring, witnessed pauses in breathing and unrefreshed sleep. The diagnosis, 
however, requires an electrographic sleep study revealing repeated sleep-state- 
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dependent obstructions of the upper airway that disrupt breathing and sleep. 
Obstruction of the upper airway in OSAS results in cessations in ventilation 
lasting at least 10 s that is associated with a drop in the oxygen level (apneas) 
and/or significant reductions in ventilation also lasting at least 10 s and requir¬ 
ing a drop in the oxygen level (hypopneas). Obstruction of the upper airway 
imposes numerous physiological stresses on individuals with sleep apnea, in¬ 
cluding rapid fluctuations in tissue oxygen and carbon dioxide levels, intratho- 
racic pressure swings and augmented sympathetic drive [1], Events are termi¬ 
nated typically with an abrupt arousal. These disordered breathing events may 
be repeated once every minute or two of sleep, resulting in markedly disrupted 
sleep with severe daytime sleepiness and/or fatigue in the majority of individu¬ 
als with OSAS. Intriguingly, obstructed breathing in individuals with sleep ap¬ 
nea occurs only during sleep [1], In waking there is minimal fixed obstruction, 
and breathing is quiet and regular. This sleep-state dependency for all obstruc¬ 
tion supports the concept that disrupted breathing in sleep apnea should be 
readily amenable to pharmacotherapies, if we could identify the underlying 
sleep-related change. 

Individuals with OSAS have more readily collapsible upper airways [1], Con¬ 
sequently, they rely on upper airway dilator muscles to maintain patency of the 
upper airway, particularly during inspiration when the pressure within the air¬ 
way becomes subatmospheric [2, 3], The upper airway dilator muscles include 
the genioglossus, or tongue, several muscles that position the hyoid bone an¬ 
teriorly, and the muscles that lift the soft palate. A normal response to sleep is 
reduced tone in most striated muscles, including all of the upper airway dilator 
muscles mentioned above. The tone in upper airway dilator muscles declines in 
non-rapid-eye-movement (NREM) sleep and falls even further in REM sleep. 
Thus, normal sleep-state-dependent reductions in muscle tone underlie collapse 
of the upper airway and obstructed breathing. Wakefulness quickly restores ac¬ 
tivity of the dilator muscles. Although these changes underlie sleep-disordered 
breathing in adults and children with OSAS, there are many differences across 
individuals with OSAS that add complexity to developing pharmacotherapies. 
The precise site of critical narrowing of the airway may vary across patients, 
and thus, the muscles and neurochemical changes responsible for upper airway 
collapse may vary across patient groups [4, 5], In addition, the sleep stage in 
which the events are most likely to occur may vary, and this, too, could vary 
the neurochemical mechanisms underlying airway collapse [6], In some patients 
with OSAS, apneas begin as unobstructed cessations in breathing following a 
large sigh at the termination of a previous obstruction [7], This central (unob¬ 
structed) apneic event may also have a unique neurochemical mechanism. Thus, 
as we move forward to develop drug therapies for OSAS, we must also advance 
our phenotypic characterization of this disease, to determine whether subsets 
of patients will respond differently to the various therapeutic directions. It is 
highly probable that OSAS, as a complex disorder, will not be a “one drug fits 
all” disorder. 
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OSAS: epidemiology and co-morbidities 

The greatest risk factor for increased collapsibility of the upper airway is obe¬ 
sity, as the increased fat volume increases the volume and weight of soft tissue 
surrounding the upper airway. With obesity reaching epidemic proportions in 
many regions of the world, the prevalence of OSAS is on the rise. OSAS is 
present in at least 4% of adult males and over 2% of adult females in the North 
America [8], Prevalence is equally high in Europe, Australia and in urban regions 
in Asia and South America [9-11]. Other major risk factors for OSAS include 
increased adenoid and tonsil lymphoid tissue, macroglossia, nasal obstruction 
from allergies, chronic sinusitis or nasal polyps, and skeletal constraints on the 
upper airway, e.g., retrognathia and maxillomandibular hypoplasia [7], In light 
of the diverse predisposing factors contributing to the risk, age at onset and 
severity of OSAS, it is equally imperative that these factors be included in the 
phenotype. Here again, it is possible that OSAS resulting from obesity may 
show a different treatment response from OSAS secondary to retrognathia. 

OSAS has been identified as an independent risk factor for hypertension 
[12], insulin resistance, congestive heart failure and cerebrovascular ischemic 
events [13, 14], OSAS is also associated with significant neurobehavioral im¬ 
pairment [15], The impairments may manifest as impaired wakefulness, poor 
memory, reduced concentration, and an increased risk of motor vehicle acci¬ 
dents [15], Thus, the need to treat OSAS is clear. 

Despite the high prevalence of this disease and its significant co-morbidi¬ 
ties, there are no widely effective pharmacotherapies for OSAS. Therapeutic 
goals must include treating the cardiovascular, endocrine and neurobehavioral 
morbidities, as well as the disrupted sleep. The ideal approach, then, is to ef¬ 
fectively prevent collapse of the upper airway, which, in turn, should prevent or 
minimize the morbidities of this disorder. To date, the most effective therapies 
for OSAS are mechanical therapies, and the effectiveness of these approaches 
should serve as important benchmarks for developing clinical goals for a phar¬ 
macotherapy for OSAS. 


Effectiveness of non-pharmacological therapies for sleep apnea 

Mechanical therapies have provided many persons with OSAS substantial sub¬ 
jective improvement in sleepiness and have reduced the incidence of serious 
cardiovascular morbidities [15, 16]. However, these treatment options com¬ 
pletely alleviate respiratory disturbance events in only a minority of patients, 
and the therapies require either lifetime use of a device or surgery. The most 
effective therapy for OSAS is continuous positive airway pressure (CPAP). 
This positive pressure is delivered to a securely fitted nasal and/or oral mask 
to stent open the upper airway and prevent collapse. When the positive pres- 
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sure needed to prevent obstructive breathing and snoring, without causing ad¬ 
ditional arousals or central apneas from too high a pressure, is identified and 
prescribed, this device can very effectively alleviate sleep-disordered breathing 
in most individuals. Downsides from a patient perspective include maintenance 
required for care and cleaning of the mask, the effort required to position the 
mask when sleepy and ready for bed, the snug fit required for fit of the mask. 
These drawbacks represent potential barriers to the use of CPAP for all sleep 
[17]. Despite these drawbacks, it is important that patients recognize the value 
of this therapy. In males with severe OSAS, defined as >30 apnea/hypopnea 
events per h, CPAP usage reduces cardiovascular morbidity and mortality [16]. 
Upper airway surgery to remove upper airway soft tissue can dramatically im¬ 
prove OSAS and sleepiness in some patients, but not all, and the percentage of 
patients with normal breathing in sleep after this surgery is small [18], Another 
approach has been to extend the mandible forward with an oral appliance fitted 
over the upper and lower teeth. These devices are also successful in only a sub¬ 
set of patients [19]. Positional therapy (preventing sleep in the supine position) 
and dietary restriction or weight loss surgeries may also provide reductions in 
sleep-disordered breathing events, but may only be successful again in select 
subsets of patients [20, 21], 

The goals for a pharmacotherapy for OSAS, therefore, must be to develop 
safe, well-tolerated medications that alleviate or substantially reduce the fre¬ 
quency of sleep-disordered breathing events. In light of the ability of CPAP to 
reduce cardiovascular, endocrine and neurobehavioral morbidities, the phar¬ 
macotherapies will be required to meet the same therapeutic goals. While such 
medications elude us presently, the heightened understanding of neurochemi¬ 
cal mechanisms underlying sleep, breathing and sleep apnea brings us closer to 
effective therapies. 


Neurochemical mechanisms underlying sleep apnea events 

The neural mechanisms underlying state-dependent reductions in upper air¬ 
way dilator muscle tone are complex, and it is likely that behavioral state, per¬ 
haps even NREM and REM sleep independently, may modify neural control at 
more than one site within the nervous system to result in reduce tone in upper 
airway dilator activity. Thus, potential regions to target pharmacologically for 
OSAS include sites involved in behavioral state control of motor and ventila¬ 
tory responses, the central respiratory pattern generators and central respira¬ 
tory drive sites, as well as upper airway motoneurons. That all neurochemical 
changes must ultimately translate into neurochemical changes at upper airway 
dilator motoneurons has provided a valuable focus for much of the research 
into the mechanisms underlying sleep-disordered breathing. 

Numerous neurochemicals directly influence the activity of upper airway di¬ 
lator motoneurons, in particular the hypoglossal neurons that innervate the ge- 
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nioglossus. Glycine, GABA, and glutamate are the major neurotransmitters at 
upper airway motoneurons, and there are numerous neuromodulators, includ¬ 
ing serotonin, noradrenaline, acetylcholine, substance P, thyrotropin-releasing 
hormone, orexin, and adenosine that have been shown to be active at upper air¬ 
way dilator motoneurons [22-25], Which of these neurochemicals demonstrate 
sleep-state-dependent changes at the hypoglossal motor nucleus, has been a 
major focus in sleep apnea research. 

One of the challenges, however, in studying the neurochemical changes at 
upper airway motoneurons has been the need to use animal models, most of 
which do not have obstructed breathing. Thus, we have learned a great deal 
about the neurochemical control of the upper airway in the normally ventilat¬ 
ing rodent in recent years, but we will need to translate this to animal models 
with obstruction and ultimately to humans to confirm similar mechanisms or 
identify unique neural mechanisms. 

In the unanesthetized rodent, without obstructed breathing, serotonin does 
not play a major role in the waking excitatory activity at upper airway moto¬ 
neurons or in the sleep-related suppression of upper airway activity [26], In 
contrast, noradrenaline is important for genioglossus muscle tone in waking 
and in NREM sleep; reductions in noradrenaline delivery to the hypoglossal 
motor nucleus in NREM sleep account for most of the muscle suppression in 
NREM sleep [26, 27], However, it is important to recognize that delivery of 
serotonin to the hypoglossal motor nucleus in NREM sleep can also prevent 
muscle suppression in this sleep state. In REM sleep, noradrenaline plays a 
minimal role, and serotonin microinjected into the hypoglossal motor nucleus 
in REM sleep does not restore normal respiratory activity of the genioglossus 
muscle as it does in NREM sleep [26, 27], Thus, the neuromodulation of upper 
airway dilator motoneuron activity in sleep involves, not only serotonin and 
noradrenaline, but must involve changes in at least one other neurochemical 
to explain the suppression of muscle activity in REM sleep. GABAergic and 
glycinergic changes do not appear to contribute to this suppression [26, 27], 
and thus, acetylcholine or a novel neuromodulator may contribute to REM 
sleep-dependent muscle suppression. 

Research in non-rodent animal models of obstructed breathing in sleep sup¬ 
port the concept that either the neural mechanisms vary with species or vary 
with the presence of obstructive breathing in sleep. Specifically, the English 
bulldog has sleep-dependent obstructive breathing, [28] and serotonin appears 
to play an important role in the maintenance of upper airway activity and pa¬ 
tency in this animal model of OSAS [29, 30], Like the human, the dog has 
a highly collapsible upper airway and relies on upper airway dilator muscles 
in waking to maintain patency [28], In sleep, normal sleep-related reductions 
in muscle activity result in snoring, airway collapse and obstructed breathing 
[28], In REM sleep, oxyhemoglobin desaturations can be severe [28], In this 
natural animal model of obstructive sleep disordered breathing, we tested the 
importance of 5-HT for upper airway patency [29], The English bulldogs were 
instrumented for sleep studies and electromyography of major upper airway di- 
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lator muscle. The dogs were given an injection of one of two 5-HT antagonists, 
methysergide or ritanserin, while awake [29], After administration of either an¬ 
tagonist, waking snoring was observed and oxyhemoglobin saturations fell [29], 
The fall in saturations was coincident with reduced upper airway dilator muscle 
activity. In two dogs, cinematic computerized tomography was performed while 
recording airway muscle activity and oxygen saturation. Inspiratory collapse of 
the upper airway was observed at the time when muscle activity was suppressed 
[29], These data suggest that the maintenance of a patent upper airway, at least 
in this model of obstructive sleep-disordered breathing, requires serotonergic 
activity. It is important to acknowledge that the systemic injections do not al¬ 
low conclusions of where the 5-HT acts to maintain patency. 

Studies in this animal model also suggest that increased 5-HT activity should 
be an effective means of reducing obstructive sleep-disordered breathing. Spe¬ 
cifically, a randomized, double-blinded trial tested the effects of three doses 
of two serotonergic agents in the bulldog [30], The drugs selected for study 
were L-tryptophan and trazodone. L-Tryptophan increases central nervous sys¬ 
tem production and release of 5-HT from serotonergic neurons [31]. Thus, 5- 
HT delivery may be augmented, even when neuronal activity is quiescent, as 
in REM sleep. The drug tested in combination with L-tryptophan was trazo¬ 
done. Trazodone is a weak selective serotonin reuptake inhibitor (SSRI) and 
also has an active metabolite, m-CPP, that is a 5-HT agonist that crosses the 
blood-brain barrier [32], This combination of serotonergic drugs in the English 
bulldogs produced a dose-dependent reduction in obstructive sleep-disordered 
breathing in NREM sleep to an apnea/hypopnea index of < 1/h, but in REM 
sleep the effect was less and the apnea/hypopnea index remained over 10/h [30], 
Preliminary studies with trazodone alone and with L-tryptophan alone showed 
less effect on NREM and REM sleep events [30], 

Collectively, these results in the English bulldog model of OSAS support the 
concept that individuals with OSAS have narrowed, collapsible upper airways 
and require serotonergic excitation, relative to normal individuals, to maintain 
normal respiration. Moreover, this work in animal models suggests that sero¬ 
tonergic drugs may be effective in treating OSAS, if the correct serotonergic 
mechanisms and receptor subtypes are identified as clinically safe targets. 


The pharmacology of serotonergic control of respiration 

There are at least 14 5-HT receptor subtypes in the central and peripheral ner¬ 
vous system in most mammalian species tested [33], and serotonergic control of 
ventilation occurs at multiple sites within the nervous system, including behav¬ 
ioral state control groups, central respiratory drive and pattern generator sites 
and upper airway motoneurons. 

Serotonergic modulation of upper airway dilator motoneurons involves sev¬ 
eral 5-HT receptor subtypes, including both pre- and postsynaptic receptors in 
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the hypoglossal nucleus. Micropunches of tissue within the hypoglossal nucleus 
have been used to detect the presence of mRNA for several 5-HT receptor sub- 
types: 5-HT 1B 2A 2C 3 7 [34], The tissue in micropunches includes not only mo¬ 
toneurons, but glial cells, blood vessels, other neurons with soma, dendrites 
and/or axon terminals within the hypoglossal nucleus. To identify 5-HT recep¬ 
tor subtypes on hypoglossal motoneurons exclusively, we developed a method 
of single motoneuron laser capture for semi-quantitative information on post- 
synaptic 5-HT receptor subtypes [35], Using this technique, we identified the 
predominant 5-HT receptor subtype mRNA in hypoglossal motoneurons as 
5-HT 2A [35], A second minor 5-HT receptor subtype present in hypoglossal mo¬ 
toneurons is 5-HT 2C . Pharmacological trials of selective serotonergic agents in¬ 
jected into the hypoglossal nucleus demonstrate that the major excitatory 5-HT 
receptor subtype is 5-HT 2A and there is a weak, but present, 5-HT 2C effect in the 
hypoglossal nucleus [36], Unfortunately, 5-HT 2A is an undesirable target, as ac¬ 
tivation of 5-HT 2A receptors systemically can exacerbate hypertension, anxiety, 
psychosis, asthma, and hypercoagulability [37], Thus, an excitatory postsynap- 
tic 5-HT receptor target for upper airway motoneurons still eludes us. 

In addition to the excitatory postsynaptic effects of 5-HT 2A , there is an im¬ 
portant presynaptic inhibitory effect with activation of 5-HT 1B receptors [38], 
Specifically, 5-HT 1B agonists injected into the hypoglossal nucleus suppress hy¬ 
poglossal nerve activity, and injection of 5-HT 1B antagonists into the nucleus 
augments hypoglossal respiratory activity, suggesting spontaneous or intrinsic 
5-HT 1B inhibition in the hypoglossal nucleus [38], To date, 5-HT 1B antagonists 
have not been examined clinically in OSAS, but they could be quite useful. 

In addition to important effects on upper airway dilator motoneurons, 5-HT 
may influence ventilatory drive and pattern in multiple sites and through sev¬ 
eral receptor subtypes in the brainstem. Direct excitatory effects of 5-HT have 
been observed for select groups of brainstem respiratory neurons [39], Activa¬ 
tion of the 5-HT 2 receptor subtypes with iontophoretic application of alpha- 
methyl-5-HT depolarizes medullary expiratory and post-inspiratory neurons, 
resulting in increased tonic and phasic respiratory activity of phrenic neurons 
[39], Systemic administration of a partially selective 5-HT 1A agonist, 8-OH 
DPAT, increases respiratory drive, while ventilation can be suppressed by 5- 
HT 1A antagonist drugs [40], Both 5-HT 1Aand2 agonists increase respiratory rate, 
when injected into the fourth ventricle, suggesting involvement of an additional 
group of brainstem respiratory neurons [41], 

There are also important serotonergic influences on abnormal respiratory 
rhythm patterns. The pre-Botzinger region in the caudal brainstem generates 
the respiratory rhythm in mammals, and at this site 5-HT can influence altered 
ventilatory drive. Within this respiratory rhythm generator, the 5-HT 1A receptor 
(5-HT 1A R) is the most extensively expressed 5-HTR. 5-HT 1A R agonists applied 
directly to these respiratory rhythm neurons suppress apneusis, a pattern of 
markedly prolonged inspiratory effort [42], This breathing pattern may occur 
in barbiturate overdoses, and 5-HT 1A R agonists, including buspirone, a par¬ 
tial 5-HT 1A R agonist, can reverse the drug-induced apneusis. A second 5-HTR 
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subtype with respiratory effects in the pre-Botzinger area is 5-HT 4 R. A highly 
selective 5-HT 4 R antagonist, CB113808, induces central apneas when injected 
into the pre-Botzinger area, while a selective agonist, BIMU8, increases respi¬ 
ratory drive and importantly can reverse narcotic-induced apnea without re¬ 
versing the analgesic effect of narcotics [43], Thus, 5-HT 4 R agonists will likely 
have utility in managing opioid-induced ventilatory suppression, but may also 
have potential for sedative- and sleep-induced ventilatory suppression. The 
third 5-HTR subtype with activity in the pre-Botzinger region that influences 
abnormal breathing is the 5-HT 2A R that is critical for post-ischemic gasping 
and recovery of suppressed ventilatory drive. As mentioned above, this is a less 
desirable target for systemic pharmacotherapies, but is important to consider 
when exploring the feasibility and potential effectiveness of drugs targeting 
multiple serotonergic receptors. 

Activation of the 5-HTR on respiratory neurons in the nucleus tractus soli- 
tarius in the rat increases respiratory frequency, while 5-HT activation of inter¬ 
neurons with respiratory outputs can in some cases reduce ventilatory rate and 
minute ventilation [44], In addition to 5-HT 1A activation of ventral respiratory 
neurons, the excitatory effect of 1A receptors may also include the dorsal mo¬ 
tor vagal nucleus [45], In support of a local dorsal motor nucleus effect is the 
observed increase in respiration following local application of the 5-HT 1A ago¬ 
nist, 8-OH DPAT. 

Serotonergic respiratory control has also been explored in the peripheral 
nervous system. 5-HT applied to the nodose ganglion suppresses respiration 
and induces apneas [46], 5-HT 3 is responsible for peripheral suppression of 
ventilatory drive [47], Administration of a 5-HT 3 antagonist, ondansetron, to 
normal rats, reduced the number of central sleep apneic events, and this effect 
is clearly a peripheral effect, consistent with activation of the nodose ganglion 
[48,49], Oral administration of this same 5-HT 3 antagonist to the English bull¬ 
dog, reduced the number of sleep-disordered breathing events in REM sleep, 
without affecting NREM sleep events [50], Therefore, 5-HT 3 antagonists may 
be effective in reducing REM sleep events in some individuals with OSAS. De¬ 
spite an encouraging case study [51], a recent clinical trial in individuals with 
OSAS did not observe an overall effect of mirtazapine on OSAS events [52], 
perhaps because in addition to being a potent 5-HT 3 antagonist, mirtazapine 
blocks 5-HT 2 receptors. 


Clinical trials of serotonergic drugs for OSAS 

There are, at present, several significant challenges in designing and implement¬ 
ing clinical drug trials for OSAS. Because of the significant risk of cardiovas¬ 
cular morbidity in OSAS and because CPAP therapy appears to reduce the car¬ 
diovascular morbidity and mortality associated with the disease, the treatment 
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goals must reach beyond a statistically significant reduction in the frequency of 
apneas and hypopneas, and should include normalization of sleep-disordered 
breathing [17]. The second obstacle is that because OS AS treatment effective¬ 
ness is presently determined with polysomnography, polysomnography should 
be performed across multiple doses and placebo, thereby incurring enormous 
cost for clinical trials. A third obstacle is the large night-to-night variability in 
the severity of apnea and hypopnea frequency for persons with mild to moder¬ 
ate disease [53], The variability requires either very large subject enrollment or 
multiple studies per subject, also adding to the time commitment for studies, 
in addition to cost. Thus, most of the trials performed to date have been inad¬ 
equately powered statistically and have not tested multiple doses. Nonetheless, 
the studies have provided some insight into the potential for serotonergic drugs 
in OSAS. 

One of the first serotonergic drugs tested was 1-tryptophan [54], 1-Trypto¬ 
phan was evaluated as a hypnotic to consolidate sleep in persons with idiopathic 
CNS hypersomnolence [54], Analyzing the original pilot study data, research¬ 
ers observed that use of 1-tryptophan was associated with marked reductions 
in nighttime cardiac arrhythmias. The drug was then tested for effectiveness on 
nighttime dysrhythmias and apneas in persons with OSAS. The study design 
was an unblinded, non-placebo controlled study in which doses varied signifi¬ 
cantly between patients, as did the timing of drug administration and duration 
of drug treatment (days to weeks). Nevertheless, there were several promising 
findings observed for the group of 15 patients studied. 1-Tryptophan lowered 
the individual respiratory disturbance indices in every person studied, despite 
an increase in REM sleep time. The group apnea index dropped from 46 to 
29/h (p<0.001) [54], The total time spent during respiratory events for the sleep 
period was also reduced (from 122 to 79 min, p<0.01). Individuals with mild 
OSAS showed the best response. The improvement appeared to be greater in 
NREM sleep than in REM sleep. 1-Tryptophan usage, however, has been as¬ 
sociated with life-threatening pulmonary hypertension [55], 

Buspirone is an anxiolytic that acts, in part, as a partial 5-HT 1A agonist [56], 
As mentioned above, however, the overall effect of systemically administered 
5-HT 1A agonists is an increase in respiratory rate [54], The anxiolytic effect of 
buspirone is unique in that the drug has stimulatory effects on respiration [57], 
Because of its respiratory stimulant effect, buspirone has been tested for effec¬ 
tiveness in persons with sleep apnea [57], In a preliminary report, the apnea in¬ 
dex, in five persons with OSAS, improved from 31 ±9 to 20±10 apnea/h, but in 
one of the five subjects, the apnea index worsened from 35 to 59 apnea/h [57], 
Here again, there may be subsets of patients with OSAS who would respond to 
buspirone, and thus, it would be helpful to more fully develop the phenotypes 
of responders and non-responders. 

After several reports emerged describing the excitatory effects of 5-HT on 
respiratory motoneurons [18-20], fluoxetine, an SSRI, was examined [58], The 
effects of fluoxetine for OSAS was analyzed for its effects on both sleep and 
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sleep-disordered breathing in 12 patients before and after each of the following 
conditions: 4 weeks of fluoxetine (20 mg/day), and compared to protriptyline, 
a noradrenaline uptake blocker, for 4 weeks at 10 mg/day, and placebo [58], 
The study design was a series of randomized, double-blinded, cross-over trials. 
Fluoxetine was well tolerated, and all patients completed the study. However, 
compliance with therapy was not rigorously tested. The group apnea/hypop- 
nea index improved with fluoxetine from 58±9 to 32±8 events/h, p<0.05. A re¬ 
markably similar effect on apnea/hypopnea indices was observed with protrip¬ 
tyline. There was, however, tremendous variability in response for both drugs. 
One person with a baseline frequency of 46 obstructive events/h had 2/h on 
fluoxetine, while in another subject the frequency of events increased from 18 
to 49 events/h on fluoxetine. Despite a reduction in the events overall for the 
group, there were no significant differences in oxyhemoglobin desaturations or 
in sleep fragmentation. Whether these results signify a success of fluoxetine in 
some but not all patients, or whether the variance in response is night-to-night 
variability in individual sleep-disordered breathing severity has not been dis¬ 
cerned with larger clinical studies. 

Paroxetine, another SSRI, has been shown to reduce NREM sleep obstruc¬ 
tive events in persons with mild to moderate disease [59], Paroxetine was studied 
in a randomized, double-blind, cross-over trial of 20 patients with moderate- 
severe OSAS. The drug was administered daily (20 mg) for 6 weeks prior to the 
on-drug polysomnography; the duration of the washout period was 4 weeks. 
Paroxetine dropped the apnea index on average by 10 events/h in non-REM 
sleep (p<0.02), but had no effect on REM sleep events or REM sleep time. 
Data on the effects of the drug on oxyhemoglobin saturations were not re¬ 
ported. In a separate study in persons with severe OSAS, acute administration 
of 40 mg paroxetine (4 h before polysomnography) increased genioglossus peak 
muscle activity without impacting upon the frequency of obstructions [60], It 
is unclear in this acute study what effect paroxetine had on serotonin delivery 
to motoneurons. Nevertheless, paroxetine may have a role in persons with very 
mild NREM OSAS, who cannot tolerate either CPAP or an oral appliance and 
who also have an indication to use this drug for psychiatric illness. 

Trazodone, a drug that alters serotonergic neurotransmission through mul¬ 
tiple mechanisms, may improve OSAS. The drug is a weak SSRI, and while 
trazodone itself is a 5-HT 2C antagonist, its metabolite is a powerful 5-HT 2C 
agonist, with an overall effect of increasing 5-HT 2C activity. In a case report of 
a person with olivopontocerebellar degeneration and obstructive and central 
SDB, trazodone markedly reduced both types of SDB events without disrupt¬ 
ing sleep architecture [61]. In this individual patient, trazodone reduced the 
respiratory disturbance index over 50% without affecting sleep architecture. 

As mentioned in the previous section, 5-HT 3 antagonists in a larger clini¬ 
cal trial were shown not to influence OSAS severity and may increase appetite 
and weight gain in addition to sleepiness. Thus, this avenue no longer looks 
promising. 
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Future directions 

It appears that serotonergic drugs may be effective for treating at least several 
subsets of individuals with OSAS. In particular, adults with mild NREM sleep 
OSAS and minimal REM sleep OSAS are most likely to benefit from seroto¬ 
nergic therapy. The receptor targets may include 5-HT 1B antagonism, and/or 
5-HT 1A 4or7 agonists. For REM sleep disease it is quite likely that cholinergic/ 
adenosinergic therapies may be needed to supplement the NREM selective ef¬ 
fect of serotonergic therapies and provide relief from REM sleep events. The 
most expeditious approach to identifying safe and effective serotonergic phar- 
macotherapeutics will be to develop an animal model with NREM sleep and 
REM sleep obstructive apneas and begin testing drugs carefully across large 
dose ranges and for long-term therapy. The models can be developed by re¬ 
moval of the hyoid arch in obese rats, rabbits or guinea pigs. With successful 
therapies substantiated in multiple species, large-scale clinical trials with ad¬ 
equate power and sufficient dose range across well-characterized subsets of in¬ 
dividuals with OSAS will be able to determine precisely who may benefit from 
serotonergic pharmacotherapies. 
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Abstract 

Antidepressants, in general, affect sleep. The most consistent effect is suppression of the 
rapid eye movement (REM) sleep, and this is observed both in healthy volunteers and de¬ 
pressed patients. REM is affected most by drugs that block the reuptake of serotonin, like 
the selective serotonin-reuptake inhibitors (SSRIs) and the serotonin-noradrenaline-reup- 
take inhibitors (SNRIs). Further, these drugs often disrupt sleep continuity. The 5-EIT 1A 
agonist anxiolytics (azapirones) like buspirone show an REM suppressant effect but they 
do not affect sleep continuity. We discuss this difference in terms of likely explanatory 5- 
HT mechanisms for the above effects. With chronic treatment, there is gradual diminution 
of the sleep effects of the SSRIs. Finally, we discuss the subjective sleep effects of these 
drugs, which are often different from the polysomnographic ones. 


Introduction 

The selective serotonin-reuptake inhibitors (SSRIs) and the serotonin-norepin- 
ephrine-reuptake inhibitors (SNRIs) are first line treatments for depression and 
anxiety disorders nowadays [1, 2], Both of these classes of drugs, as well as 
most of the older tricyclics (TCAs), block the reuptake of serotonin from the 
synapse back to the nerve terminal, thus increasing synaptic serotonin, and this 
action is considered instrumental in their antidepressant effect and anxiolytic 
effect [3-5], Some other antidepressant compounds have a mixture of other 
actions on the 5-HT system, including agonism of 5-HT 1A receptors, and ago- 
nism or antagonism of 5-HT 2A and 5-HT 2C receptors. More selective 5-HT 1A 
agonists, the azapirones, of which the prototype in clinics is buspirone, have 
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not proved to be very useful as antidepressants but are anxiolytics. However, 
their anxiolytic spectrum is rather restricted and they are mainly indicated for 
generalized anxiety disorder [6], 

A complex relationship exists between these drugs, their sleep effects, and 
the conditions they treat. The purpose of this chapter is to highlight the role 
that serotonin (5-HT) plays in underpinning this triangular relationship. The 
preclinical science related to this topic is treated extensively in other chapters 
of this book; we focus on published controlled studies in healthy volunteers, in 
depressed and anxious patients. 

Disruption of sleep is a major symptom of the conditions the SSRIs, SNRIs 
and azapirones are called to treat. Over 90% of depressed patients have some 
sleep complaints, thus making sleep disturbance the most ubiquitous symp¬ 
tom of the depressive illness [7], It is precisely this sleep disturbance that often 
leads the patient to seek help. Further, relief from this problem is important 
to encourage compliance with medication and psychological treatments, and 
reduces the risk of suicide [8], Sleep disturbance is also prominent in anxiety 
conditions, with a prevalence that reaches 70% in generalized anxiety disorder 
(GAD), although the type of disturbance tends to differ from that of depres¬ 
sion [9], 


The study of human sleep 

When studying sleep in humans, as opposed to experimental animals, some 
epidemiological and methodological aspects need to be borne in mind. Sleep 
patterns are very variable from person to person; in general the average adult 
sleeps for about 7-8 h a night, but some need only 4-5 h, while others may 
need as much as 10-12 h. The amount of sleep is deemed to be sufficient if the 
sleeper feels rested and refreshed in the morning, and they are able to perform 
the next day’s activities adequately. Many people experience intermittent dif¬ 
ficulties with their sleep. Periodically, they may be spending a long time trying 
to get off to sleep, or they may wake up during the night or very early in the 
morning. When these difficulties become established and persistent, they have 
daytime consequences such as fatigue, poor concentration, and diminished 
ability to perform everyday tasks. At this stage, the person is said to suffer from 
insomnia. For most people, periodic insomnia is short lived and responds to 
simple measures of treatment, but for a substantial number of sufferers it be¬ 
comes chronic, entrenched and very debilitating. 

Researchers and clinicians dealing with sleep disturbances can gather ob¬ 
jective information about the sleep of a subject by means of the well-estab¬ 
lished technique of polysomnography. This entails the recording of night-time 
electroencephalographic waves (EEG) and other physiological variables such 
as muscle activity and eye movements during sleep. From the extensive expe¬ 
rience acquired with polysomnography, a relatively stable normal pattern of 
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sleep consisting of five different stages emerges. This pattern varies from person 
to person, but usually it contains four or five fairly regular cycles of quiet sleep 
alternating with paradoxical or active sleep. The quiet sleep is divided further 
into four stages. Stage 1 (‘dozing’) is a very light sleep halfway between sleep 
and waking and stage 2 is slightly deeper, sometimes with occasional small 
jerks. Stages 3 and 4, also called slow wave sleep, constitute the deep sleep dur¬ 
ing which some restorative processes in the body take place, for instance growth 
hormone is released. When the time since the last sleep “episode” increases, 
the amount of slow wave sleep increases. During paradoxical sleep, the EEG 
appearance is similar to that of waking, but there is complete paralysis of the 
skeletal muscles. The characteristic jerky movements of the eyes during this 
stage led to this stage being named rapid eye movement (REM) sleep. Stages 
1^1 are then referred to as non-REM sleep. The staging of sleep using the EEG 
recording is standardized [10]. Most slow wave sleep takes place in the first 
half of the night and periods of REM become progressively longer with each 
successive cycle of sleep; therefore, most REM appears in the second half of 
the night. The pattern of occurrence of the various stages over the night is 
normally referred to as “sleep architecture”. The amounts of time spent in each 
sleep stage, the number of cycles and the amount of interruption by waking 
show wide inter-subject but much less intra-subject variability. In general there 
is a definite effect of age, with less slow wave sleep and more time spent awake 
the older the subject. 

It is also of note that the correspondence of the objective polysomnographic 
findings of somebody’s sleep with the subjective experience of the same person 
is not straightforward [11], and it is not uncommon in clinic to encounter dis¬ 
crepancies such as reported dissatisfaction with sleep versus what appears to be 
a relatively normal hypnogram. Hence, in sleep studies and clinics the subjec¬ 
tive experience of the individual investigated ought to be recorded as well. 


Sleep architecture in depression and anxiety 

The study of sleep patterns in depression and anxiety, which was originally 
driven by their clinical significance outlined above, proved to be very fruitful. 
Alteration of sleep architecture became one of the most robust biological find¬ 
ings in depression. Many patients enter REM sleep earlier than control sub¬ 
jects, i.e., their REM sleep onset latency (ROL) is reduced, and non-REM sleep 
appears to be reduced in the first sleep cycle. These two findings suggested that 
there is a disruption in both the circadian and the homeostatic drives to sleep. 
It was soon proved that effective treatments of depression, like (nearly all) the 
antidepressant drugs and electro-convulsive therapy (ECT), alter sleep in the 
opposite direction to the changes produced by the condition. This led to the 
idea that sleep can serve as an indirect biological marker of the therapeutic ef¬ 
fects of these drugs in the brain [12], Evidence showed that patients are more 
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likely to respond to antidepressants rather than psychological treatments if 
these sleep changes occur in the course of the illness, and they also fare less well 
with psychological approaches compared with patients with a normal sleep 
profile [13]. This knowledge could be used potentially to decide which treat¬ 
ment modality ought to be chosen for a particular individual. 

Changes in sleep architecture in anxiety are less pronounced than the ones 
observed in depression, but increased sleep latency, more awakenings and re¬ 
duced sleep efficiency are reported in panic disorder and GAD compared to 
controls. There is no major disturbance of REM sleep in the anxiety condi¬ 
tions. On the other hand, sleep phenomena peculiar to anxiety disorders may 
occur, such as nocturnal panic attacks that are seen by up to 45% of panic 
disorder patients [9], and which arise during non-REM sleep. 

Finally, as described later in this chapter, the antidepressants and 5-HT 1A ag¬ 
onists produce sleep effects that evolve during the process of treatment. There¬ 
fore, longitudinal studies could yield important information about the adaptive 
mechanisms that are thought to be implicated in the therapeutic action of the 
drugs. Sometimes, but not always, the sleep effects of the drugs are also present 
when healthy volunteers are tested. The study of specific sleep variables could 
then provide a window through which the brain effects of 5-HT could be ob¬ 
served and manipulated to acquire deeper understanding of its biological role 
in illness and health. 


Effects of SSRIs on REM sleep 

Two characteristic dose-related effects on REM sleep have been reported for 
the SSRIs. They occur both in healthy volunteers and depressed patients. The 
time to the first REM sleep episode (otherwise known as ROL) is increased, 
and the total amount of REM sleep over the period of a night is reduced. The 
combination of these two effects, also seen to varying degrees with TCAs and 
monoamine oxidase inhibitors (MAOIs), are referred to as REM suppression. 
In fact, this phenomenon is so widespread with antidepressants of all classes 
that it led to the proposition that REM suppression is a necessary condition for 
any drug to have an antidepressant effect. However, this view was not sustain¬ 
able since some antidepressants, like trimipramine and nefazodone, were found 
not to suppress REM [14], Increased availability of serotonin in the synapsis, 
following the inhibition of its reuptake by the antidepressant, is thought to be 
the cause of these REM phenomena. They are most likely mediated through 
the 5-HT 1A receptor. A preclinical study showed that the REM-suppressing ef¬ 
fect of citalopram was absent in 5-HT 1A -knockout mice [15]. In humans, drugs 
that are selective 5-HT 1A agonists suppress REM strongly [16], as discussed in 
more detail later in this chapter. Finally, temporary reduction of the availability 
of 5-HT by means of rapid tryptophan depletion in patients treated with SSRIs 
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reverses the REM suppression induced by the antidepressants [17]. Further, 
tryptophan depletion in healthy volunteers led to decreased ROL and increased 
total REM time [18]. Another study in healthy controls did not detect decrease 
of ROL but the intervals between REM episodes were shortened and more 
REM sleep occurred earlier in the night compared with the control condition 
[19], Somewhat conflicting results (increase in ROL but also increase in REM 
density at the beginning of the night) have been reported in volunteers when 
tryptophan depletion takes place a few hours before the onset of sleep [20], 
Presumably this allowed for adaptive mechanisms to come into play. Taken to¬ 
gether, the above evidence strongly suggests that 5-HT plays a major role in 
REM regulation. 

The degree of REM suppression may vary according to the population 
studied, the length of treatment, and the specific compound used. Single-dose 
studies often show small effects on ROL, and this is usually due to the time of 
dosing. The SSRIs have relatively long absorption times and maximum plasma 
levels are not achieved until about 4-8 h after ingestion. If the drug is given at 
bedtime, plasma levels are probably not high enough early in the night to delay 
the first REM episode. However, the maximal effects of the SSRIs on REM 
sleep can be seen early in treatment, with the exception of fluoxetine, where the 
onset of these phenomena appears to be somewhat slower. In one study, the 
maximum increase in ROL after a single 40 mg dose was observed on the third 
night after ingestion [21], Presumably, this ought to be attributed to the long 
time it takes norfluoxetine, the active metabolite of fluoxetine, to reach steady 
state. Further, the REM changes with fluoxetine appear to be smaller in magni¬ 
tude compared with the other SSRIs. 

The REM suppression effects gradually diminish with chronic treatment. 
Total REM amount in particular, which is markedly reduced early in therapy, 
returns toward baseline gradually, so studies after 8 weeks or more of treatment 
rarely show significant reductions in REM. This diminution or even restoration 
of REM sleep is less often seen with fluoxetine than the other SSRIs [14]. 

Following the discontinuation of an SSRI, the REM amount shows a re¬ 
bound increase. This was seen 4-12 days after the withdrawal of fluoxetine [21] 
and 6 days after the withdrawal of citalopram [22], On the other hand, ROL 
does not appear to be as susceptible to these withdrawal and rebound effects. 


Effects of SSRIs on sleep initiation and continuity 

SSRIs are alerting both for volunteers and depressed patients. Sleep onset la¬ 
tency increases, thus making sleep initiation more difficult. Sleep continuity 
is disrupted; light (stage 1) sleep increases, and so do the number of arousals 
from sleep and the time spent awake at night. In general, the magnitude of this 
alerting effect is larger in normal volunteers compared to depressed subjects. 
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This is probably due to the large baseline differences between the two groups. 
Depressed patients are obviously starting out with much more disrupted sleep 
than the volunteers, and therefore further deterioration is less pronounced. An¬ 
other important aspect of the treatment with SSRIs is that the sleep distur¬ 
bance diminishes over time, with most studies in depressed patients showing no 
difference from baseline after a few days of treatment. The exception to this is 
fluoxetine, which, in a large multicenter study, continued to disrupt sleep conti¬ 
nuity after 8 weeks of treatment [23], 

The fragmentation of sleep continuity and the alerting effects are probably 
not explained by the stimulation of 5-HT 1A receptors, which are responsible 
for REM effects. Potent 5-HT 1A agonists, as discussed later, do not have the 
same marked sleep-fragmenting effects as the SSRIs [24], It is postulated that 
stimulation of post-synaptic 5-HT 2 receptors is involved in the alerting process. 
Blocking these receptors with compounds like nefazodone leads to improve¬ 
ment of sleep continuity [23, 25], On the other hand, meta-chloro-phenylpi- 
perazine (mCPP), which is a 5-HT 2 agonist, is quite sleep disrupting [26], Fur¬ 
ther, the relatively quick desensitization of these receptors with treatment could 
explain the early reduction of the alerting effects. 


Slow wave sleep and delta sleep ratio with SSRIs 

There have been very few reports of changes in overall amount of deep (slow 
wave) sleep after treatment with SSRIs [27], Despite this lack of significant ef¬ 
fect on slow wave sleep, delta sleep ratio (DSR) has been tentatively explored 
over the last few years in the quest for an EEG sleep change which would pre¬ 
dict clinical response, since EEG changes precede therapeutic effect by weeks. 

In normal subjects, episodes of slow wave activity in non-REM sleep oc¬ 
cur discretely, interspersed with the REM episodes in a cyclical pattern, and 
diminishing over the night according to the homeostatic process of sleep de¬ 
scribed first by Borbely [28], In depressed patients the ratio of the slow EEG 
activity in the first sleep cycle to that in the second cycle (DSR) is lower than in 
normal subjects. In two studies, one with the predominantly serotonergic TCA 
clomipramine and another with the SSRI sertraline, DSR has been reported 
to be increased after antidepressant treatment [29, 30], In the first one of these 
studies only those patients who responded to treatment showed this increase 
in DSR. However, as described above, antidepressants delay the first REM pe¬ 
riod, allowing the first sleep cycle to be very long and thus the amount of slow 
wave activity in the first cycle is high. This increase in DSR is therefore most 
likely caused by ROL changes, which also occur in normal subjects. Nefazo¬ 
done, one of the few antidepressants that do not suppress REM sleep, does not 
improve DSR, while in the same study paroxetine, a REM-suppressing SSRI, 
does [31]. 
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Sleep effects of the SNRIs 

The SNRIs combine the inhibition of the reuptake of serotonin of the SSRIs 
with that of norepinephrine. Venlafaxine, the first marketed drug of this class, 
has about five times greater action on the serotonin transporter than the nor¬ 
epinephrine one, and (unlike the TCAs) very little action at neurotransmitter 
receptors. The sleep effects of venlafaxine are similar to those of the SSRIs 
such as paroxetine or TCAs such as clomipramine [14], A report of another 
dual transmitter reuptake blocker, duloxetine, and sleep in healthy volunteers 
suggests a similar effect, with increased ROL and decrease in total REM sleep 
duration, while sleep continuity was disrupted in higher dose (120 mg/day) but 
not in the lower one (80 mg/day) [32], A small open study with depressed pa¬ 
tients showed that the drug produced REM suppression, as expected, but also 
an increase in Stage 3 sleep [33], Milnacipran, on the other hand, appears in 
the single study in depression to increase REM latency without decreasing the 
amount [34], These are early reports and they need to be confirmed. 


5-HT 1A agonists (azapirones) and sleep 

These drugs were billed for years as the “future anxiolytics” but theirs has 
largely been an unfulfilled promise. Buspirone, the prototype of this class, fol¬ 
lowed the old fashioned serendipitous route to clinical practice, and had been 
developed originally as a novel antipsychotic before it was discovered that it 
had anxiolytic properties [35], It was finally marketed worldwide in the 1980s 
with GAD as its primary indication. The excitement with this drug originated 
from the hope that it would offer an alternative to benzodiazepines, as it did 
not cause tolerance or dependence. However, the compound never lived up to 
the high expectations. Its use in other anxiety indications and depression fal¬ 
tered because of lack of efficacy [6], 

It is thought that the anxiolytic mechanism of buspirone is exerted via its 
agonist properties at the 5-HT 1A receptors. This insight led to the development 
and investigation of a host of other agonists, a number of which were also 
azapirones. Results from animal models of anxiety were positive; however, very 
few controlled trials were subsequently published and these compounds gener¬ 
ally failed to make it to the market. An example is ipsapirone, which showed in 
early studies some promise in the treatment of GAD, and it did not appear to 
produce rebound anxiety on discontinuation. The drug was not developed any 
further and it is only used today as a challenge for the 5-HT 1A receptor system 
[36], The strongest anxiolytic data for a new 5-HT 1A compound were produced 
for gepirone but in recent years the focus on the development of this drug seems 
to have shifted towards depression rather than anxiety [37], Tandospirone, on 
the other hand, gained license for anxiety in Japan, but what scarce information 
from trials exists for this compound in English addresses only accessory issues 
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of treatment, such as abuse liability [38], The available data of lesopitron on 
GAD are far from convincing [39], while the published information on zalop- 
sirone is mainly for depression [40], Similarly, no anxiety studies with eptapir- 
one have been published. Interestingly, a study with the non-azapirone 5-HT 1A 
agonist flesinoxan reported worsening of anxiety in panic disorder patients that 
lasted throughout the treatment period [41], so this drug is also used mainly 
as a probe nowadays. A whole host of other compounds were in development 
at some time, but for most of those the only information in the public arena 
refers to preclinical studies (alnespirone, S-15535, DU-125530) or other indica¬ 
tions (repinotan). Overall, although not all of these new compounds have been 
tested for their sleep properties, they do not seem to be substantially different 
from buspirone, either in their efficacy or their subjective side effect profiles, 
mainly of dizziness, nausea and headaches. 

As mentioned earlier in the text, the REM sleep-suppressing effects of the 
SSRIs are thought to be mediated via the effects of increased serotonin on 
5-HT 1A receptors, perhaps in the REM-generating areas of the pons. Beyond 
the evidence from knockout mice experiments mentioned already [15], Monti 
and Jantos [42] showed that fluoxetine induced REM suppression when in¬ 
jected into the pontine tegmental nucleus of rats and that this effect could be 
blocked by pre-treatment with the 5-HT 1A antagonist compound WAY 100635. 
In humans also, the selective 5-HT 1A partial agonist drugs mentioned in the 
previous paragraph tend to be strong suppressors of REM sleep. Pharmacoki¬ 
netic differences between these drugs and the SSRIs exist that have an impact 
on their sleep effects. The 5-HT 1A agonists act more quickly; the time to their 
maximum plasma concentration is approximately 15-30 min, while for most of 
the SSRIs is 4-6 h. Further, they are eliminated more rapidly, with a half-life of 
approximately 2 h compared to the 24-30 h of the SSRIs. 

All but two of the sleep studies of 5-HT 1A agonists were in healthy volun¬ 
teers; the first investigated six insomniac patients [43] and the second exam¬ 
ined parallel groups of depressed patients and healthy volunteers [44], REM 
suppression is reported in the single dose-studies, particularly in the first 3 h 
of sleep [16, 24, 43^19], These changes appear to be modest with buspirone 
and more marked with ipsapirone, although no direct comparison study has 
been reported. There are no direct comparisons with SSRIs either, but 5-HT 1A 
agonists appear to affect mainly REM latency, and the amount of REM is 
only reduced in the first part of the night. This difference from the SSRIs may 
be related to the pharmacokinetic properties of the two types of drugs. The 
amount of REM suppression could also be related to the intrinsic agonist ef¬ 
fect; Wilson et al. [24] reported a comparison of two 5-HT 1A agents, buspirone 
and eptapirone, which shows REM-suppressing effects in accordance with the 
differing intrinsic efficacy of the two drugs in preclinical studies (Fig. 1). There 
are no chronic studies, although Manfredi and co-workers [43] reported 7-day 
dosing with buspirone and Driver and co-workers [47] 14 days of ipsapirone in 
volunteers, with the REM suppression remaining but not increasing during the 
sub-chronic phase of treatment. 
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REM Onset Latency 



evening morning 


Sleep Onset Latency 



evening morning 

Fig. 1 Changes in sleep onset latency and REM onset latency after single doses of bu- 
spirone 20 mg, eptapirone 1.5 mg or placebo (given at 23:00) or eptapirone 1.5 mg (given 
at 10:30). This was a crossover study in young male volunteers [24] 

* Significantly different from placebo 


As to sleep initiation and maintenance, 5 mg buspirone caused a slight in¬ 
crease in wake time after sleep onset [43] and 10 mg and 20 mg ipsapirone de¬ 
creased sleep efficiency [44,48], These latter authors also showed increased slow 
wave sleep in the first sleep cycle, and increased slow wave activity, after acute 
ipsapirone. Driver and colleagues[47] reported a decrease in SWS after 10- 
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14 days of dosing . Wilson et al. [24] reported an increase in sleep onset latency 
after morning but not evening dosing of eptapirone. Interestingly the REM 
sleep changes and sleep fragmentation by ipsapirone were not significantly dif¬ 
ferent in depressed patients and volunteers given a single dose of the drug [44], 
Overall, the changes in REM sleep are similar to those following ingestion 
of SSRIs but, interestingly, the changes in sleep continuity and slow wave sleep 
are unlike those of SSRIs. This is further evidence supporting the idea that the 
sleep fragmentation after SSRIs is not mediated via the 5-HT 1A receptor. 


Subjective sleep effects of the SSRIs and SNRIs 

The subjective sleep effects of antidepressants have not been studied as sys¬ 
tematically as the polysomnographic ones. In most clinical studies the focus 
is on the treatment response, and sleep change is only a secondary outcome 
measure, with the results being reported summarily. When some subjective 
sleep measurement is employed, this is mostly in the form of a self-rated sleep 
diary, and/or the three sleep items of the observer-rated Hamilton Rating Scale 
for Depression (HAM-D). These items cover the aspects of early, middle and 
late insomnia, each one scored from 0 to 2. The more detailed self-rated sleep 
questionnaires that have some validity data supporting their use [50] have been 
very scarcely employed in the study of antidepressants. Of those, the use of 
the Leeds Sleep Evaluation Questionnaire (LSEQ) [51] has gained currency in 
recent years. This questionnaire consists of ten 100-mm visual analogue scales 
yielding four factors: getting to sleep, quality of sleep, awakening from sleep, 
and behavior following wakefulness. Overall, the scale appears to be reliable 
and consistent [52] and the findings from its application in studies of various 
psychotropic agents in normal volunteers, depressed patients and insomniacs 
have been reviewed in detail [53]. 

The evaluation of the subjective sleep effects of antidepressants is very im¬ 
portant for a number of reasons. Clinicians made use of the sedative property 
of some old compounds, an effect that would otherwise be considered as an 
adverse event, to treat sleep complaints, whether they are related to depression 
or not. This long-established clinical practice became very prominent at the 
height of the discussion about the abuse and tolerance potential of the benzo¬ 
diazepines. So, when the SSRIs were marketed prescribers and patients quickly 
focused on the sleep properties of these drugs. Polysomnography is not used 
routinely in the clinic but, anyway, there is no direct correspondence between 
objective and subjective sleep measures in what constitutes a good night’s sleep 
[11], A substantial number of patients with sleep complaints do not show any 
objective findings [54], The ability of patients to perceive and report their ob¬ 
jective sleep accurately is less important clinically than their subjective feelings 
[55]; therefore, these subjective perceptions in relation to the drug they ingest 
should be studied closely. 
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The SSRIs are the most extensively investigated antidepressants with regards 
to their subjective sleep properties. The effects on healthy volunteers tend to be 
neutral or some deterioration of sleep is reported in higher doses [27, 53], In 
depressed patients, however, there is often a discrepancy between objective and 
subjective measurements with this class of drugs. While the objective measures 
show that the SSRIs affect sleep negatively, at least in the early stages of treat¬ 
ment, the subjective measures show improvement. A number of putative ex¬ 
planations have been put forward to account for this difference in effect. It has 
been suggested that concomitant medication, such as benzodiazepines, is some¬ 
times freely available in studies measuring subjective effects; this seems to hap¬ 
pen much less in objective studies of sleep [27], However, the use of extra medi¬ 
cation cannot explain why the same discrepancy is seen in studies that measure 
objective and subjective sleep effects simultaneously. As we discussed already, 
the correspondence of these two types of measurement is limited [11], It has 
also been suggested that a halo effect of general improvement of the depression 
may bias the subjective reports of sleep quality [27], This may be compounded 
by the common reporting practice of presenting the baseline and endpoint data 
only. As we mentioned earlier, there is tolerance to the sleep disrupting effects 
of the SSRIs in polysomnography. Further, improvement of sleep has gener¬ 
ally set in by the end of an antidepressant study, which usually lasts for at least 
6-8 weeks. It might be more appropriate then to report the sleep data of the 
first few weeks of a study, when the patient has not yet seen any improvement 
in his/her mood and the sleep disturbance is at its peak. When we applied this 
in a study of the sleep effects of nefazodone and paroxetine in depressed outpa¬ 
tients, the results were illuminating in that respect [25], 

Paroxetine is the most extensively studied compound in this area. Acute 
double-blind studies, using the HAM-D sleep items, showed that paroxetine in 
doses of 20-30 mg/day produced as good an improvement in subjective sleep as 
the traditional sedative TCA amitriptyline [56, 57], The first of these two stud¬ 
ies also highlighted that according to the LSEQ, getting to sleep became easier 
and quality of sleep improved equally as a result of both treatments. Another 
6-week study showed that paroxetine (15-30 mg/day) was superior in subjective 
sleep compared to mianserin (30-60 mg/day), and that six out of the ten indi¬ 
vidual items of LSEQ (including ease of getting to sleep, speed of getting to 
sleep, restfulness of sleep, and reduced awakenings) were significantly improved 
compared with baseline [58], 

In an 8-week study of fluoxetine (20 mg/day) compared with placebo in de¬ 
pressed patients, the drug did not appear to worsen subjective sleep; in fact it 
was better than placebo but the difference did not reach statistical significance 
[59], Another large 6-week open study showed that all four LSEQ factors and 
the HAM-D sleep items improved significantly with fluoxetine, and that this 
effect was more pronounced in responders [60], Finally, a comparison of fluox¬ 
etine (20 mg/day) with the TCA dothiepin in a 6-week study of depressed pa¬ 
tients showed that both treatments were equally associated with normalization 
of sleep as the patients became less depressed. Both drugs had an early positive 
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impact on the ease of getting to sleep, with improvement in the corresponding 
subscale of LSEQ. Both drugs also improved sleep quality [61]. 

A large («=400) comparison of citalopram (two groups 10-30 mg/day and 
20-60 mg/day) with imipramine in depressed patients for 6 weeks, failed to 
show a difference between the two drugs in the reduction in HAM-D sleep 
items [62], However, a meta-analysis of the HAM-D sleep items from five ran¬ 
domized controlled trials of citalopram vs TCAs showed that overall the TCAs 
had a much more pronounced effect on subjective sleep than this particular 
SSRI [63], Escitalopram, the follow-on compound of citalopram, has not been 
studied with respect to its sleep properties to any significant degree. 

There have been few comparisons between SSRIs. Sertraline (mean dose 
72 mg/day) was tested against fluoxetine (mean 28 mg/day) in an 8-week study 
of depressed patients, and both drugs produced significant improvement in the 
HAM-D sleep items and in LSEQ, with the exception of factor 3 (difficulty in 
awakening and time it took to wake up) [64], Another 6-week comparison of 
the same drugs (sertraline (50-100 mg/day vs fluoxetine 20-40 mg/day) again 
reported significant reductions from baseline for both drugs in the HAM-D 
insomnia items. Further, this was strengthened by a parallel reduction in the 
mean daily dose of temazepam used. Finally, significant improvement from 
baseline was also reported for LSEQ [65], Equal improvement on LSEQ was 
seen in another 24-week study of over 200 depressed patients comparing the 
same two drugs (sertraline 50-150 mg/day vs fluoxetine 20-60 mg/day) [66], 


SSRIs and dreaming 

Nightmares are sometimes reported as an adverse event in clinical trials of 
SSRIs [67], It should be borne in mind though that the presence of depres¬ 
sion may be a contributing or even deciding factor for this effect. Reports of 
enhancement of dreaming exist with fluoxetine [68, 69] and citalopram [70], 
while for sertraline changes in dream content have been noted [71]. A 3-week 
controlled study of healthy volunteers showed an increase in emotional inten¬ 
sity of dreams but a decrease in their recall with fluvoxamine and paroxetine. 
Further, there was an increase in length of dream reports and bizarreness of 
their content during withdrawal from fluvoxamine [72], 

The mechanism for these effects remains unclear. The increased number 
of awakenings during REM sleep in SSRI-treated subjects, and the fact that 
bouts of REM are moved towards morning wakening by the REM-suppress- 
ing mechanism (see earlier), could both affect dreaming. However, these doc¬ 
umented SSRI-induced changes cannot account for the increased emotional 
intensity. Further, excessive dreaming has been described as a withdrawal phe¬ 
nomenon for nearly all antidepressants [72, 73] and may be possibly due to 
rebound cholinergic effects. 
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Subjective sleep effects of the azapirones 

Studies that examined the subjective sleep effects of buspirone (10 mg and 
20 mg), ipsapirone (5 mg) and eptapirone (2 mg) in healthy volunteers reported 
no changes in sleep perception [24, 47] or insomnia [43], 


Practical implications of the effects of antidepressants on sleep 

In the treatment of depression, no single effect of antidepressants on sleep ar¬ 
chitecture is necessary or sufficient for their therapeutic efficacy. However, dif¬ 
ferences between compounds may be useful in informing the choice of drug for 
a particular patient. As discussed above, most effective antidepressants improve 
sleep after a few weeks of treatment. There may be situations, however, where 
an earlier improvement of sleep, that is before the mood-lifting effects become 
apparent, may be desirable. Sometimes, insomnia is particularly distressing. In 
other cases, adherence to long-term treatment may depend on the early relief 
of particularly troublesome symptoms like sleep disruption. In these cases, the 
choice of a safe and effective antidepressant that improves sleep acutely would 
be indicated. On the other hand, if for some other reason an SSRI or an SNRI 
are the preferred choice for such a patient, a short-term hypnotic may be used in 
conjunction with the antidepressant. Some patients with depression complain 
of excessive sleep or daytime somnolence. The prevalence of these symptoms is 
not known, due to lack of sufficient published data distinguishing somnolence 
from fatigue in depression. In patients with this kind of symptom profile, sleep- 
promoting antidepressants should be avoided and the more alerting SSRIs or 
SNRIs would be preferable. 
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Abstract 

Patients with schizophrenia commonly report problems related to disturbed sleep, most 
often presenting as difficulties with sleep onset latency (SOL) or with sleep maintenance, 
whereas others have identified disrupted circadian sleep control such as phase delay and 
even free running cycles. Several studies have evaluated objective measures of sleep abnor¬ 
malities in patients with schizophrenia by means of polysomnographic techniques. While 
the majority of published reports are associated with substantial methodological problems 
that confound interpretation of the data presented, some consistent patterns of findings 
can be observed across a number of studies examining sleep physiology in schizophrenic 
patients. The most consistently reported findings have included prolonged SOL and in¬ 
creased wake time after sleep onset (WASO). Additionally, some studies reported dimin¬ 
ished slow-wave sleep (SWS) time in patients with schizophrenia as compared to healthy 
controls, and other studies noted short REM latency (REM-L). However, the latter two 
findings were not as consistently replicated across studies. Considerable progress has been 
made in recent years in delineating neurobiological mechanisms involved in the regula¬ 
tion of sleep and wake states as well the coordination of transitions within sleep from 
one state to another (e.g., regulating transitions from non-REM to REM sleep stages). In 
addition to the major excitatory and inhibitory neurotransmitter systems glutamate and 
GABA, monoamine neurotransmitter systems, including dopamine (DA), norepinephrine 
(NE), serotonin (5-HT), acetylcholine (ACh) and histamine have all been demonstrated 
to play important roles in the sleep state regulation process. Antipsychotic drugs, includ¬ 
ing both the typical and atypical antipsychotic classes, have all been shown to produce 
prominent inhibitory effects at DA D 2 receptor sites. Additionally, to varying degrees, dif¬ 
ferent antipsychotic drugs produce modulatory effects on 5-HT, NE, ACh and histamin- 
ergic receptors, thereby providing a strong rationale for anticipating prominent effects of 
antipsychotic drugs on sleep physiology when administered to patients with schizophrenia, 
other psychiatric disorders as well as to healthy control subjects. A number of studies have 
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reported data on effects of antipsychotic drugs on sleep measures in patients with psychi¬ 
atric disorders and in healthy control groups. Many of the published reports are noted to 
have significant methodological limitations, making interpretation of the findings tenuous 
in some cases. Nevertheless, some consistent patterns of findings have been reported to 
date. In general, administration of typical antipsychotic drugs has been noted to result in 
improved sleep continuity, as characterized by increased total sleep time, increased sleep 
efficiency and decreased SOL and WASO. In these studies, SWS was generally not altered 
but REM-L was occasionally increased. In studies examining effects of the atypical anti¬ 
psychotic drugs, generally similar patterns of improvement of sleep continuity measures 
have been reported across the various agents in this class, but some differences have been 
noted in terms of effects on SWS and on parameters of REM activity. Differences in ef¬ 
fects of various atypical antipsychotic drugs on sleep may be explained by their differing 
pharmacological mechanisms of action. Substantial limitations are noted in terms of the 
studies of effects of atypical antipsychotic drugs on sleep. For several of the drugs in this 
class, no published studies have characterized their effects in the clinical populations in 
which they are used most extensively. Thus, there is a need for much further work in this 
area of great clinical importance. 


Introduction 

This chapter focuses on a review of effects of antipsychotic drugs on sleep, 
primarily concentrating on studies carried out with these agents in patients 
with schizophrenia, but also making reference to studies examining effects of 
antipsychotic drugs on sleep parameters in patients with other psychiatric dis¬ 
orders and in normal volunteers. Only representative examples with regard to 
studies of sleep effects of the typical antipsychotic agents are cited, whereas the 
literature addressing this topic for atypical antipsychotic drugs is covered more 
comprehensively. Reasons for adopting this approach include the large num¬ 
ber of drugs in the typical antipsychotic drug category as well as the fact that 
current prescribing patterns for the treatment of schizophrenia in the United 
States indicate an overwhelming preponderance in the use of the atypical an- 
tipsychotics. Prior to a review of the pharmacological aspects of this topic, we 
start with a discussion of sleep alterations in schizophrenic patients. 


Sleep alterations in schizophrenic patients 

On the basis of subjective self reports, problems with insomnia [marked by 
prolonged sleep onset latency (SOL), impaired sleep continuity and/or a sense 
of non-restful, non-restorative sleep, associated with some degree of impaired 
daytime functioning] occur at least occasionally in a substantial subset of 
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adults. Epidemiological studies carried out in a number of countries have con¬ 
sistently documented that one-third or more of individuals sampled report at 
least occasional difficulties with impaired sleep [1], Several review articles have 
emphasized the point that sleep problems are especially ubiquitous among pa¬ 
tients with psychiatric disorders, affecting patients across virtually all diagnos¬ 
tic categories including depression, mania (i.e., bipolar disorder), a broad range 
of anxiety disorders, substance abuse disorders and schizophrenia [2-7], 

With respect to schizophrenia, a substantial percentage of schizophrenic pa¬ 
tients describe problems with prolonged sleep latency and markedly impaired 
sleep continuity [3, 4], The presence of intense, disturbing dreams and night¬ 
mares is another common manifestation of sleep alteration in schizophrenia, 
and this particular phenomenon has provided part of the rationale for the pro¬ 
posal advanced by some investigators that alterations in REM physiology rep¬ 
resent an important biological substrate of the disorder. Clinicians know that 
an abrupt, pronounced deterioration in the sleep-wake cycle of a patient with 
schizophrenia can represent an ominous harbinger of an impending psychotic 
decompensation. In one study examining the functional impact of impaired 
sleep in schizophrenic patients, a significant relationship was observed between 
subjective reports of poor sleep quality and reduced perception of quality of 
life in other functional domains [8], 


Objective assessments of sleep physiology in patients 
with schizophrenia 


As described in several previous reviews [2-4, 9], a number of studies have 
employed polysomnographic (PSG) techniques to provide objective documen¬ 
tation of sleep alterations in patients with schizophrenia. Before commenting 
on the patterns of findings obtained in these studies, it should be noted that 
Monti and Monti [4, 9] have provided detailed and thoughtful reviews of work 
carried out in this area, accompanied by careful descriptions of the extensive 
methodological shortcomings that confound interpretation of the findings 
reported to date. Among the troubling shortcomings associated with these 
studies are: small numbers of subjects included, inconsistent approaches to 
establishing the primary psychiatric diagnosis, failure to exclude patients with 
co-morbid medical, neurological or sleep disorders, inclusion of schizophrenic 
subjects with varying degrees of acuity or chronicity of illness, confounding 
effects of age and of prior treatment with antipsychotic agents, as well as acute 
withdrawal effects, and confounding effects of other concomitant medications. 
A more extensive list of the methodological shortcomings in sleep studies of 
schizophrenic patients noted by Monti and Monti [9] is provided in Table 1. 
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Table 1 Methodological shortcomings in PSG studies of schizophrenia. 

• Variability in diagnostic approach and definitions applied 

• Wide age range of patients enrolled 

• Inclusion of patients in different phases of illness 

• Lack of screening for the presence of primary sleep disorders 

• Concurrent use of medications with potential sleep-altering effects 

• Mix of drug-naive and previously medicated schizophrenic patients 

• Variable periods of time for withdrawal of previously administered antipsychotics 

• Small numbers of subjects included 

• Lack of inclusion of a control group or poor comparability between groups 

• Incomplete adaptation to the sleep lab environment 
Adapted from Monti and Monti [4] 


While the methodological confounds associated with studies in this area 
have clearly contributed to inconsistencies in the results obtained, Monti and 
Monti [4, 9] were able to identify some generally consistent trends in the studies 
that they judged to be conducted with sufficient methodological rigor to merit 
consideration in their review. Thus, as compared to controls, schizophrenic pa¬ 
tients who had never been medicated demonstrated increases in sleep latency 
and several manifestations of impaired sleep continuity, including increased 
wake time after sleep onset (WASO) and increased number of awakenings dur¬ 
ing the night, as well as decreased total sleep time and sleep efficiency (SE). 
In terms of characterization of sleep architecture findings, they directed com¬ 
ments about sleep-wake determinations specifically to assessments of stage 4 
sleep, and noted that the amount of stage 4 sleep was very low in both the 
never-medicated schizophrenic patients and in the normal controls, resulting 
in an inability to detect a difference between the groups on this parameter. The 
authors speculated that the surprisingly low stage 4 sleep levels in the normal 
controls may have indicated a lack of adequate acclimation of subjects to the 
conditions of the sleep laboratory. With respect to REM sleep assessments, 
they noted comparable findings for schizophrenic patients and normal controls 
with respect to REM sleep time, but described a substantial reduction in REM 
latency (REM-L) that was reported in some, but not all studies. 

Monti and Monti [4, 9] also carried out assessments of evaluable studies 
involving schizophrenic patients who had previously been treated with antipsy¬ 
chotic drugs, with the previously neuroleptic-treated subjects having been drug- 
free prior to PSG assessment for periods of time ranging from 2 to 8 weeks. As 
the authors note, this factor introduces the potential confound of discontinua¬ 
tion/withdrawal effects following termination of their previously administered 
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antipsychotic drug regimen. This complicating factor notwithstanding, the au¬ 
thors identified several consistent patterns of findings across the ten studies 
deemed appropriate for analysis. Compared to the control groups included, the 
previously treated but currently drug-free schizophrenic patients were noted to 
have prolonged SOL and increased WASO. Stage 4 sleep was reduced in sev¬ 
eral, but not all studies. Total sleep time (TST) was comparable between schizo¬ 
phrenic patients and controls in most studies, and REM-L was shortened in 
five of the nine published reports reviewed by the authors for which such data 
were available. 

Summarizing their analysis across evaluable studies, including never-medi¬ 
cated and previously treated schizophrenic patients, the authors commented 
on generally consistent findings or frequently observed findings of: prolonged 
SOL, impaired sleep continuity, reduced stage 4 sleep and shortened REM-L. 
They also concluded that findings of sleep onset prolongation and impairment 
of sleep maintenance were observed in studies involving schizophrenic patients 
irrespective of the phase of clinical course (i.e., first episode, acute exacerbation 
or chronic stage of illness). 

In a review of sleep studies of schizophrenic patients, Benson [3] pointed out 
that the finding of shortened REM-L, which was noted in several studies, might 
occur as a consequence of a reduction in slow-wave sleep (SWS). Ordinarily, 
the first episode of SWS occurs approximately 30-40 min after sleep onset and 
is the most prominent episode of SWS during the entire night. Benson points 
out that the presence of SWS exerts an inhibitory effect on the neurobiological 
mechanisms, leading to the induction of a REM episode. Thus, she speculated 
that a diminution in the initial SWS episode “would permit the passive advance 
of the first REM period”, ([3], p. 1035), leading secondarily to the finding of 
short REM-L. 

With respect to the reports of SWS alterations in schizophrenic patients, Ke- 
shavan et al. [10] reported that the observed reduction of SWS was correlated 
with several factors, including age, severity of negative symptoms and duration 
of illness [10], Other studies in this area have employed more detailed assess¬ 
ments of EEG frequency bands, with reports of reduced delta (1-4 Hz) and 
theta (4-8 Hz) frequency bands in schizophrenic patients relative to controls in 
some studies [11, 12], 

To extend this line of investigation, Ferrarelli et al. [13] employed the tech¬ 
nique of high-density EEG imaging to assess the dynamics of sleep EEG find¬ 
ings in patients with schizophrenia as compared to normal subjects and to sub¬ 
jects with a history of depression. In this study, they evaluated the EEG power 
as well as slow waves and spindles during the first non-REM episode. Subjects 
enrolled in this study included 17 normal volunteers, 18 subjects with a his¬ 
tory of schizophrenia and 15 subjects with a history of depression. Notably, 
subjects in the schizophrenia group were receiving antipsychotic medications 
(the majority of whom were on atypical antipsycho tics) at the time of EEG 
sleep study assessment. Additionally, the majority of schizophrenic subjects 
were receiving antidepressant drugs and/or mood stabilizers, and, additionally, 
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3 schizophrenic patients were receiving benzodiazepine compounds. Among 
the subjects with a history of depression, 7 were in remission at the time of 
evaluation, 6 had scores on the Hamilton Depression Rating Scale indicative 
of mild to moderate depression, and 2 subjects had scores characterized as be¬ 
ing in the severe depression range. Some of the subjects with a history of de¬ 
pression were being treated with an antidepressant drug, mood stabilizer or 
benzodiazepine at the time of EEG assessment. Thus, potential confounding 
effects of psychopharmacological medications must be considered in assessing 
the findings reported in this study. 

Key findings from this study related to analyses of sleep spindle proper¬ 
ties. Sleep spindle number, amplitude and duration were found to be signifi¬ 
cantly reduced for subjects in the schizophrenic group as compared to subjects 
with a history of depression and to normal controls. A measure of integrated 
spindle activity provided the largest effect size of all of the spindle parameters 
evaluated. The authors noted that the dimension of integrated spindle activ¬ 
ity provided 93% separation of schizophrenic patients and controls, and 90% 
separation between schizophrenic patients and subjects with a prior history of 
depression. These findings point to further characterization of sleep-related 
neurophysiological features that characterize schizophrenic patients in compari¬ 
son to the normal volunteers and subjects with a prior history of depression 
who were included in this study. However, it should be re-emphasized that the 
presence of antipsychotic medications as well as several other psychopharma¬ 
cological drug classes in the schizophrenic patients studied represents a poten¬ 
tially confounding factor relative to the findings obtained. The authors, how¬ 
ever, pointed to some other reported findings and unpublished observations 
from their own group that support the interpretation that administration of 
antipsychotic drugs per se, does not alter sleep spindle properties, indicating 
that the findings obtained in their study of reduced sleep spindle activity in 
schizophrenic patients does represent a relevant pathophysiological concomi¬ 
tant of this disorder. 


Neurobiological mechanisms of sleep regulation 

As a foundation for considering how antipsychotic drugs may affect sleep 
physiology, whether in the context of providing treatment to patients with 
schizophrenia, or when used for other indications or in other clinical contexts, 
it is important to consider basic neurobiological mechanisms believed to be in¬ 
volved in the regulation of sleep and arousal states, as discussed in other chap¬ 
ters in this text. Drugs used in the treatment of schizophrenia are known to 
exert prominent modulatory effects on many of the neurotransmitter systems 
implicated in sleep regulation. The topic of neurobiological mechanisms of 
sleep regulation has also been reviewed comprehensively in other publications 
[14-19], Here we draw attention to available data on typical antipsychotic drugs 
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(Tab. 2) and atypical antipsychotic drugs (Tab. 3) in terms of their reported 
effects on selected neurotransmitter receptors. A number of the modulatory 
effects of these agents on receptor function may be relevant to their effects in 
altering sleep quality and sleep physiology. 


Table 2 Binding affinity of selected typical antipsychotic drugs for various neurotrans¬ 
mitter receptors. 


Typical 

antipsychotic 

Receptor 






da-d 2 


Muscarinic 

ACh 

a, adrenergic 

Histaminic 

H, 

Fluphenazine 

++++ 

+ 

- 

+ 

+ 

Haloperidol 

++ 

+ 

- 

+ 

- 

Chlorpromazine 

+ 

++ 

+ 

+++ 

+ 

Thioridazine 

+ 

+ 

++ 

+ 

- 


Data adapted from [20], 

Lack or insignificant binding affinity; number of + reflect relative values for 10 7 / 
where = equilibrium dissociation constant in molarity [20], 


Table 3 Binding affinity of atypical antipsychotic drugs for various neurotransmitter 
receptors. 


Typical 

antipsychotic 

Receptor 






DA-D 2 

5-HT 2A 

Muscarinic 

ACh 

a! adrenergic 

Histaminic 

Hj 

Clozapine 

+ 

+ 

+++ 

++ 

++ 

Risperidone 

++ 

++++ 

- 

++ 

+ 

Olanzapine 

+ 

+ 

+++ 

+ 

++++ 

Quetiapine 


+ 

- 

++ 

+ 

Ziprasidone 

++ 

++++ 

- 

++ 

+ 

Aripiprazole 

Partial 

agonist 

++ 

- 

++ 

- 


Data adapted from [20, 21], 

Lack or insignificant binding affinity, number of + reflect relative values for 10~ 7 /AT d , where 
K t = equilibrium dissociation constant in molarity [20], 
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Effects of typical antipsychotic drugs on sleep 

While a number of studies have appeared utilizing PSG techniques to exam¬ 
ine effects of various typical antipsychotic drugs on sleep, we focus here on 
reviewing results from seven such studies to provide a representative overview 
of findings obtained in this area. Each study is described briefly, with key 
methodological features and significant findings obtained in each study noted. 
A summary of these findings is presented in Table 4. 

Kaplan et al. [22] reported on a study involving 13 male schizophrenic pa¬ 
tients who were assessed by means of PSG at baseline and again after approxi¬ 
mately 3 weeks of therapy with chlorpromazine. Compared to pretreatment 
baseline values, chlorpromazine administration for 3 weeks resulted in signifi¬ 
cant reductions in SOL and WASO, and significant increases in TST, stage 2 
sleep and SWS. Additionally, assessment of REM sleep parameters revealed 
significant increases in REM-L, REM activity and REM density. 

Taylor et al. [23] conducted a study with 14 schizophrenic patients, 6 of 
whom were antipsychotic drug-naive at the time of baseline assessment. The re¬ 
maining 8 patients were drug-free for at least 2 weeks prior to the baseline PSG 
assessment. Patients were treated with haloperidol or thiothixene throughout 
the period of evaluation. Ten patients also received anti-cholinergic medica¬ 
tion to address extrapyramidal symptoms (EPS). Patients were studied a sec¬ 
ond time with PSG assessments for an average of 24 days following baseline 
evaluation. Compared to baseline PSG values, treatment with the typical an¬ 
tipsychotic drugs haloperidol or thiothixene resulted in a significant decrease 
in SOL and significant increases in sleep efficiency (SE), and REM-L. There 
was also a trend for an increase in TST, although this did not achieve statistical 
significance. 

Nofzinger et al. [24] conducted a study involving 10 patients with schizo¬ 
phrenia who were studied in a double-blind, placebo-controlled crossover de¬ 
sign and who did not show significant clinical relapse following withdrawal of 
their typical antipsychotic drug regimen. Prior to the double-blind crossover 
phase, subjects were previously treated with a stable regimen of haloperidol for 
at least 6 weeks at a mean dose of 11.3 mg/day. If anti-cholinergic medication 
had been necessary during their treatment regimen, it was discontinued at least 
3 weeks prior to the initial sleep studies. PSG baseline studies were carried out 
initially while patients were on their stable regimen with haloperidol. Follow¬ 
ing withdrawal and placebo substitution, PSG studies were carried out again 
at 2 and 6 weeks of placebo crossover therapy. Results of PSG studies carried 
out at 6 weeks of withdrawal from haloperidol showed a significant increase in 
SOL and significant decreases in TST, REM sleep time and REM activity. The 
changes in these sleep parameters were much less pronounced at 2 weeks than 
was seen at the 6 week assessment times. This study provides data involving 
a reverse pattern of typical antipsychotic drug effect on sleep from the usual 
study, in which patients are evaluated at baseline prior to the start of typical 
antipsychotic drug therapy. The findings obtained reinforce the general impres- 
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Table 4 Summary of effects of typical antipsychotic drugs on sleep physiology, 
t Total sleep time, TST 
t Sleep efficiency, SE 
f Sleep onset latency, SOL 
i Wake after sleep onset, WASO 
Slow-wave sleep, SWS - generally not altered 
•f REM latency, REM-L 


sion that typical antipsychotic drug effects on sleep are most clearly manifest 
in improvement in sleep continuity measures, and may also be associated with 
increases in REM-L and REM activity. Additionally, results from this study 
emphatically underscore the concern that including patients in studies of an¬ 
tipsychotic drug effects on sleep may be confounded by their persistent effects 
(e.g., at least up to 6 weeks of withdrawal from antipsychotic medications). 

Keshavan et al. [25] reported on a study involving 15 patients with diagnoses 
of schizophrenia or schizoaffective disorder who underwent PSG assessments 
at baseline and again after 4 weeks and after 1 year of treatment. Nine of these 
patients were antipsychotic drug-naive at the time of baseline PSG assessment. 
The 6 other subjects were drug-free for at least 2 weeks prior to baseline as¬ 
sessment. Following baseline PSG, subjects were placed on a typical antipsy¬ 
chotic drug regimen, with the dose adjusted as tolerated. The mean dose of 
antipsychotic medication was a chlorpromazine equivalent dose of 178.3 mg/ 
day. It should be noted that one patient was on clozapine, 7 were on an anti¬ 
cholinergic medication for EPS symptoms and 2 subjects were on beta-block¬ 
ers. Subjects were restudied with PSG assessments after 4 weeks and 1 year 
from baseline. At 1-year follow-up, 5 patients were not taking antipsychotic 
medication due to non-compliance and 7 patients were receiving concomitant 
treatment with antidepressant or mood-stabilizer medications. For the base¬ 
line to week 4 of treatment comparison, significant increases were observed in 
sleep continuity measures, including TST and SE, associated with a significant 
reduction in WASO. With respect to measures of sleep architecture, REM-L 
was significantly increased. For the 1-year assessment after baseline, antipsy¬ 
chotic drug treatment was associated with a significant increase in TST and 
increases in several parameters of REM sleep, including REM-L, density, time 
and REM counts. It should be reiterated that potential confounds associated 
with interpretation of the 1-year follow up data include the fact that 5 patients 
discontinued antipsychotic drug treatment and a number of the subjects in this 
group were receiving concomitant medications that may well have influenced 
sleep findings, including anti-cholinergic agents, beta-blockers, antidepressant 
drugs and mood stabilizers. 
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Maixner et al. [26] conducted a study with 14 schizophrenic patients who 
were drug-free for at least 2 weeks prior to baseline PSG assessment. Three of 
the subjects included were drug-naive at the time of initial enrollment into this 
study. Following baseline PSG assessment, patients were treated with haloperi- 
dol, with a mean dose of 11.4 mg/day or with thiothixene. Ten patients received 
anti-cholinergic medication for EPS. Follow-up PSG assessments were carried 
out an average of 23 days after starting on the antipsychotic drug regimen. 
Compared to baseline values, results obtained after 3 weeks of typical anti¬ 
psychotic drug therapy included a significant decrease in SOL, and significant 
increases in TST and SE. Sleep architecture findings included an increase in 
stage 3 sleep and in REM-L. 

Wetter et al. [27] reported on an analysis of 22 previously medicated schizo¬ 
phrenic patients who were withdrawn from their prior psychotropic drug regi¬ 
men for at least 1 week. Ten of these patients were treated with the typical anti¬ 
psychotic drugs haloperidol or flupentixol. Two other groups of schizophrenic 
patients were also included in this analysis: 12 patients on the atypical antipsy¬ 
chotic clozapine and 14 drug-naive schizophrenic patients. Compared to the 
drug-naive group, patients on the typical antipsychotic drugs had significantly 
increased TST and SE and significantly decreased SOL. Additionally, REM 
time in the first cycle was significantly increased. 

Finally, Yamashita et al. [28] evaluated 10 patients with schizophrenia, 5 of 
whom were treated with the typical antipsychotic drug haloperidol and 5 with 
the atypical antipsychotic risperidone. The duration of treatment with these 
antipsychotic drugs was not specified in this report. Data presentation focused 
on a comparison of PSG results between the two drug treatment groups. The 
only significant difference between the two groups on any sleep parameter in¬ 
volved a significantly greater amount of SWS in the risperidone-treated group. 

To summarize results of assessments of effects of typical antipsychotic 
drugs on sleep parameters, despite the substantial methodological limitations 
associated with these reports, some generally consistent findings are noted, in¬ 
cluding a rather strong pattern for a decrease in SOL and an increase in various 
sleep continuity factors, such as TST, SE and WASO. With respect to sleep 
architecture changes, several studies noted an increase in REM-L and some 
other indications of increased REM activity were also noted. Limited findings 
of an increase in SWS were noted in a small percentage of studies involving the 
typical antipsychotic drugs. 


Effects of atypical antipsychotic drugs on sleep 

The final section of this chapter summarizes findings from studies examining 
effects of the atypical antipsychotic drugs on sleep. With this review, it will 
become readily apparent that the number of evaluable studies, to date, is strik¬ 
ingly small, and many of the available studies are encumbered by significant 
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methodological limitations, as has been emphasized repeatedly throughout this 
chapter. To provide the most extensive database possible, we included not only 
studies with the atypical antipsychotic drugs carried out in schizophrenic pa¬ 
tients, but also studies carried out with other psychiatric patient populations 
and with normal volunteers. 


Effects of clozapine on sleep 

Clozapine was the first of the antipsychotic drugs to be referred to as “atypi¬ 
cal”. The identification of clozapine as an atypical antipsychotic agent relates 
both to its clinical and its pharmacological features. From a clinical perspective, 
clozapine is noted for its efficacy in treatment-refractory schizophrenic patients, 
its strikingly low liability for producing EPS or tardive dyskinesia and its lack 
of effect in stimulating secretion of prolactin. Pharmacologically, the defin¬ 
ing features of clozapine as the paradigm atypical antipsychotic agent include 
lower occupancy of the dopamine (DA) D 2 receptor site at therapeutic doses 
(no more than 60% as compared with 80% of more for typical antipsychotics), 
more equivalent blockade of DA D, and D 2 receptors and potent inhibition 
of 5-HT 2A receptors [28, 29], Clozapine also has moderate 5-HT 2C antagonism 
and potent muscarinic and oij-adrenergic receptor antagonism. It also has been 
shown to exert moderate histamine H t receptor blockade, and, perhaps related 
to this property, it has been noted clinically to be associated with considerable 
sedation. 

Touyz et al. [30] conducted a study examining effects of clozapine on sleep 
in 6 normal male subjects. The study design involved a single-blind crossover 
paradigm over a 25-day period. Each subject was placed on placebo for the 
first 5 days, then crossed to clozapine at a dose of 12.5 mg for the next 15 days, 
and finally crossed back over to placebo for the final 5 days of the protocol. 
PSG assessments were carried out at designated time points throughout the 
study period. Examination of sleep parameters revealed no significant differ¬ 
ences between placebo and clozapine treatment on various sleep continuity and 
sleep architecture measures, with the sole exception that stage 1 sleep time was 
significantly reduced with clozapine administration. Two points to note with 
respect to this report are the low dose of clozapine employed and the fact that 
the normal subjects participating in this study did not demonstrate any mani¬ 
festations of sleep disorder on the basis of the baseline PSG assessments. 

As noted above, Wetter et al. [27] compared PSG sleep results in 14 drug-na¬ 
ive schizophrenic patients, 12 schizophrenic patients treated with clozapine and 
10 patients treated with a typical antipsychotic drug. Compared to the drug- 
naive group, patients treated with clozapine had significantly reduced SOL and 
significantly increased TST, SE and duration of the first REM episode. When 
compared to the group treated with a typical antipsychotic, the clozapine group 
demonstrated increased stage 2 sleep and also increased REM-L. 

Hinze-Selch et al. [29] reported on a group of 10 drug-free schizophrenic 
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patients who underwent PSG assessments at baseline and at week 1 and week 2 
of treatment with clozapine, the mean dose of which was 275 mg/day by end of 
week 2. Compared to baseline PSG findings, clozapine treatment resulted in in¬ 
creased TST, SE and REM density. Stage 4 sleep and overall SWS decreased on 
clozapine treatment, findings that appear surprising in the face of clozapine’s 
5-HT 2C blocking effects. 

Lee et al. [31] studied 5 male schizophrenic patients who were antipsychotic 
drug-free for at least 2 weeks prior to baseline PSG assessments. They were 
then started on clozapine, and PSGs were carried out at mean 4 days and mean 
46 days of treatment. Compared to results at baseline, clozapine treatment by 
end of week 1 was associated with increases in SE, TST, stage 2 sleep and num¬ 
ber of awakenings. 

Armitage et al. [32] reported on data from 14 treatment-refractory bipolar 
patients who had clozapine added to their existing bipolar medication treat¬ 
ment regimen. PSG assessments were conducted at baseline, with the pre-exist¬ 
ing bipolar treatment regimen in place, and then again after 6 months of stable 
clozapine add-on therapy. The addition of clozapine to the treatment regimen 
of these refractory bipolar patients resulted in significant increases in “time 
in bed”, TST, SOL and number of awakenings. From data collected based on 
sleep diaries assessing the subjects’ sleep-wake patterns at home, it was noted 
that 12 of the 14 patients reported going to bed an average of 55 min earlier 
than they had reported at baseline. This finding may be explained by the sedat¬ 
ing properties of clozapine. 


Effects of risperidone on sleep 

Amongst all atypicals, risperidone has the strongest affinity for both D 2 and 
5-HT 2A receptors [33], It exerts moderate antagonism at a, adrenergic receptors 
and exerts moderate 5-HT 2C receptor blockade. It has insignificant affinity for 
muscarinic and histaminic receptors. 

As is true for the atypical antipsychotic drugs in general, a very limited num¬ 
ber of studies have examined effects of risperidone on sleep, and the studies 
that are available generally involve a small number of subjects, limited time 
points of assessment and numerous other methodological complications. The 
first such study to be reviewed was carried out by Dursun et al. [34], This study 
was carried out with patients diagnosed with schizophrenia who were assigned 
to treatment with a typical antipsychotic drug (n=8, chlorpromazine equivalent 
dose of 606 mg/day), or risperidone (n=8, daily dose average of 9.5 mg). A 
group of normal controls («=8) with no history of significant medical or psy¬ 
chiatric disorders was also included for comparison to the two schizophrenia 
treatment groups. Sleep data for this study were obtained on the basis of visual 
analog scales and actigraphy monitoring. 

Compared to the control group, patients treated with risperidone showed 
comparable values for measures of sleep quality and morning sleepiness, but 
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showed higher values on the “movement index” of actigraphy monitoring. 
Compared to the typical antipsychotic-treatment group, patients treated with 
risperidone showed superior scores for sleep quality and morning sleepiness, as 
well as lower (i.e., more favorable) scores on the movement index. 

Haffmans et al. [35] reported on 23 patients with schizophrenia who were 
randomized to treatment with haloperidol (n= 12, 8.1 mg/day average dose) or 
risperidone (n= 11, 5 mg/day), with PSGs being performed at baseline and the 
end of the trial. Adequate sleep data for evaluation were available on 6 patients 
in the risperidone group and 9 patients in the haloperidol group. Stage 3 sleep 
was increased for patients treated with risperidone as compared to results for 
patients on haloperidol. Sleep maintenance increased significantly more on ris¬ 
peridone than on haloperidol and awakenings were significantly decreased on 
risperidone as compared to results in the haloperidol group. 

Yamashita et al. [28] conducted a study with 10 schizophrenic patients, 5 
treated with haloperidol and 5 assigned randomly to treatment with risperi¬ 
done. Patients in the two treatment groups had PSG assessments carried out. 
No differences between the two groups were observed for SOL, TST or SE. 
SWS time was significantly longer in patients on risperidone in comparison to 
patients on haloperidol. 

Sharpley et al. [36] carried out a study involving 8 healthy control subjects 
who were given risperidone (1 mg) for an acute dose or placebo. A separate 
group was also examined involving 8 patients with treatment-refractory uni¬ 
polar major depressive disorder. In the healthy control group, a single dose 
of risperidone (1 mg) was reported to produce one significant treatment effect 
compared to placebo of a reduction in REM sleep time. For the patients with 
treatment-refractory depression, risperidone (0.5 mg/day, which could be ti¬ 
trated up to 1 mg/day over a 2-week treatment period) produced a significant 
reduction in wake time and REM sleep time and an increase in stage 2 sleep. 


Effects of olanzapine on sleep 

Olanzapine is closely related in chemical structure to clozapine, and has a simi¬ 
lar receptor binding profile. It has potent antagonistic effects at both D 2 and 
5-HT 2A receptors with higher relative affinity for 5-HT 2A receptors [37], Other 
critical pharmacological features of olanzapine include moderate 5-HT 2C 
blockade, moderate a t blockade and potent histamine and muscarinic receptor 
blockade. Similar to clozapine, olanzapine has significant sedating effects in the 
clinical setting. As many as 35% of olanzapine-treated patients reported som¬ 
nolence in randomized controlled trials for bipolar mania (olanzapine package 
insert, Eli Lilly Inc.). 

Salin-Pascual et al. [38] evaluated 20 patients, who had been drug-free for 
at least 2 weeks, and who underwent PSG studies at baseline, and were then 
studied for the first 2 nights of treatment on 10 mg olanzapine administered 
in the evening. Compared to baseline PSG findings, olanzapine administration 
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resulted in a significant decrease in wake time and stage 1 sleep, and significant 
increases in TST, stage 2 sleep and SWS. There were no significant alterations 
in REM sleep parameters with the institution of olanzapine therapy with the 
exception of an increase in REM density on night 2. 

Sharpley et al. [39] reported on a study involving 9 healthy male controls who 
were assessed with PSG evaluations on 3 nights each, separated by 7-14 days, 
with treatments involving random-order administration of 5 mg olanzapine, 10 
mg olanzapine or placebo. Home PSG recording techniques were employed 
in this study. Olanzapine administration at either dose resulted in increases in 
SWS, sleep time, SE, stage 1 sleep and REM-L and decreases in SOL, wake 
time and REM sleep time. 

In another study reported by Sharpley et al. [40], two groups of 12 male 
control subjects with allelic variations in the 5-HT 2C gene polymorphism (either 
the serine or cysteine polymorphism) were studied by PSG following admin¬ 
istration of olanzapine (5 mg) or placebo separated by 7-14 days. Olanzapine 
treatment was associated with increases in SWS, SE and stage 1 sleep and de¬ 
creases in SOL, REM-L and number of REM episodes, but no gene effects 
were identified 

Finally, Muller et al. [41] reported on 10 male schizophrenic patients who 
were studied by PSG while drug-free at baseline, then treated with olanzapine 
(average dose of 19 mg/day) and reassessed by means of PSG after 28 days. 
Olanzapine administration resulted in significant increases in SE, TST and 
SWS and a decrease in SOL. 


Effects of quetiapine on sleep 

While few PSG studies have been reported on to date assessing effects of the 
atypical antipsychotic drug quetiapine on sleep, it seems clear that this drug 
has attracted the attention of clinicians for its apparent sleep-enhancing effects, 
and the use of this compound “off label” for sleep complaints appears to be a 
common clinical practice. Quetiapine has only moderate affinity for both D 2 
and 5-HT 2A receptors, but like other atypicals, has greater relative affinity for 
5-HT 2A than the D 2 receptors. It has strong a, receptor antagonistic properties 
and exerts moderate antagonism at histaminic and muscarinic receptors [42], 
One early signal of the propensity for quetiapine to produce prominent effects 
on sleep related to the high incidence of sedation reported in clinical trials as¬ 
sessing the efficacy and tolerability of this compound in the treatment of vari¬ 
ous psychiatric disorders, including schizophrenia, bipolar mania and bipolar 
depression. Incidences of daytime somnolence reported from these clinical tri¬ 
als ranged from 18% to 34% (Package insert, Astra-Zeneca). 

The most significant PSG study examining effects of quetiapine on sleep was 
conducted by Cohrs et al. [43] who enrolled 18 healthy male control subjects 
in a double-blind, placebo-controlled crossover study in which subjects were 
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studied for 3 consecutive nights by means of PSG on three occasions, sepa¬ 
rated by 4 nights each, with randomized administration of quetiapine (25 mg), 
quetiapine (100 mg) or placebo given 1 h prior to bedtime. Compared to pla¬ 
cebo administration, either dose of quetiapine was associated with significant 
decreases in SOL and WASO and significant increases in TST, SE and stage 2 
sleep. REM sleep time was reduced by the 100 mg dose, and a dose-dependent 
increase in periodic leg movements was also reported. 

Other studies addressing effects of quetiapine on sleep complaints have been 
carried out in more clinical contexts, with more subjective outcome measures 
being employed, For example, Sokoloski and Brown [44] presented a single 
case report of a 42-year-old male patient with severe major depression and in¬ 
somnia whose depression was treated with the monoamine oxidase inhibitor 
phenelzine, which was reported to exacerbate his symptoms of insomnia. Fol¬ 
lowing unsuccessful treatment efforts with several standard hypnotic agents, 
quetiapine was added, with the dose titrated up to 50 mg and this produced a 
significant improvement in his subjective symptoms of insomnia. 

In another single case report, Fernando and Chew [45] described a patient 
with chronic insomnia secondary to severe intractable pain whose sleep dis¬ 
turbance was markedly improved by the addition of quetiapine to his ongoing 
pain management regimen. 

Robert et al. [46] carried out a study with 20 patients with post-traumatic 
stress disorder and prominent sleep disorder symptoms. Patients were started 
on quetiapine (25 mg), with upward dose titration as tolerated. Significant 
improvement in the global sleep score on the Pittsburgh Sleep Quality Index 
(PSQI) was observed, associated with specific improvement in subjective reports 
of sleep quality, SOL, TST and episodes of terror and acting out of dreams. 

In summary, quetiapine has attracted considerable clinical attention and 
usage related to its apparently beneficial effects on sleep disorder complaints. 
Several case reports and small, open clinical trials have been conducted, with 
promising results of improvement in subjective measures of sleep disturbance 
being reported. To date, there is a striking lack of objective, PSG-based clinical 
trials, particularly focusing on patients with sleep disorders related to primary 
psychiatric disorders to provide more substantive evidence-based guidance re¬ 
garding the appropriate use of this agent in patients with primary psychiatric 
disorders and associated prominent sleep complaints. 


Effects of ziprasidone on sleep 

Ziprasidone demonstrates the expected pharmacological effects of an atypi¬ 
cal antipsychotic agent with respect to potent blockade of DA D 2 and 5-HT 2A 
receptors. Ziprasidone has been reported to demonstrate the highest ratio of 
5-HT 2A to DA D 2 receptor blockade of all of the atypical antipsychotics, and it 
also demonstrates potent 5-HT 2C blocking actions [47], Other pertinent phar- 
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macological features of ziprasidone include agonist effects at the 5-HT 1A re¬ 
ceptor and low to moderate inhibitory effects at muscarinic cholinergic, a-1 
adrenergic and histamine H, receptors. Additionally, ziprasidone demonstrates 
a unique pharmacological effect among the atypical antipsychotic agents of 
producing blockade of reuptake of monoamine [i.e., 5-HT, norepinephrine 
(NE) and DA] transporters with an affinity comparable to that of the tricyclic 
antidepressant drugs such as imipramine. 

Reports of daytime somnolence recorded during the course of clinical tri¬ 
als involving ziprasidone have ranged from 8% in patients with acute agita¬ 
tion being treated with the intramuscular preparation to 31% in patients with 
bipolar mania receiving the standard oral preparation of ziprasidone (Package 
insert, Pfizer Inc.). Only one study, to date, has reported on effects of ziprasi¬ 
done on sleep physiology. Cohrs et al. [48] reported data obtained on 12 healthy 
male controls who were studied by PSG on 2 consecutive nights on two occa¬ 
sions separated by 5 days. The study design involved a randomized, double¬ 
blind, placebo-controlled crossover design with administration of ziprasidone 
(40 mg) or placebo 2 h before bedtime. The second night for each of the two 
PSG testing periods involved the use of an acoustic stress paradigm to assess 
effects of ziprasidone in a model of simulated insomnia. Compared to placebo, 
ziprasidone administration resulted in significant increases in TST, SE, REM- 
L and stage 2 sleep and reductions in SWS, time awake, stage 1 sleep, number 
of awakenings, percent of REM sleep and REM density. The effects described 
above were observed to occur comparably across the 2 nights of ziprasidone 
administration, indicating that the sleep-preserving effects of ziprasidone were 
not comprised by an environmental stimulation designed to mimic the sleep 
disruption of primary insomnia. 

The prominent REM-suppressant effect produced by ziprasidone in the pres¬ 
ent study appears to be unique among the PSG-based studies examining effects 
of atypical antipsychotic drugs on sleep physiology. It is interesting to note that 
prominent REM suppression is produced by administration of the majority of 
antidepressant drugs [49], It is possible that the prominent REM-suppressant 
effects reported following ziprasidone administration by Cohrs et al. [48] are 
related to its unique profile of inhibiting the presynaptic monoamine uptake 
sites or its 5HT IA agonist actions [50], 

To date, the study reported by Cohrs et al. [48] represents the only pub¬ 
lished PSG study examining effects of ziprasidone on sleep. Thus, no studies 
have been carried out examining effects of ziprasidone on sleep in patients with 
schizophrenia or bipolar disorder, the clinical indications for which it has re¬ 
ceived regulatory approval. Additionally, this study involved administration of 
ziprasidone for only a 2-day interval at a dose considerably below the range 
employed in routine clinical practice. Thus, despite the promising results ob¬ 
tained in this single trial, considerably more information is needed to define the 
potential clinical utility of ziprasidone to treat sleep problems in the context of 
primary psychiatric disorders. 
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Effects of aripiprazole on sleep 

The atypical antipsychotic drug aripiprazole has a unique pharmacological 
profile for this class as a DA D 2 partial agonist [21, 51], Other pharmacologi¬ 
cal effects reported for aripiprazole include potent blockade of 5-HT 2A recep¬ 
tors, partial agonist effects at 5-HT 1A receptors, low affinity for a-1 adrenergic 
receptors and histamine H 2 receptors and negligible effects at muscarinic cho¬ 
linergic receptors [51, 52], Reports of somnolence in clinical trials involving 
administration of doses of aripiprazole between 10 and 30mg/day in patients 
with schizophrenia and with bipolar disorder ranged from 8% to 12% (Package 
insert, Bristol-Myers Squibb). A recent report described results from a study 
examining the efficacy of aripiprazole (dosed between 2 and 20 mg/day) as ad¬ 
junctive therapy to standard antidepressant drugs in treatment-refractory pa¬ 
tients with major depressive disorder (MDD) [53], In this study, which involved 
randomized, double-blind addition of aripiprazole or placebo to antidepres¬ 
sant drug therapy in patients who showed <50% reduction in baselines scores 
on the Montgomery-Asberg Depression Rating Scale (MADRS) after 8 weeks 
of antidepressant monotherapy, aripiprazole produced a significantly greater 
reduction in scores on the MADRS between weeks 2 and 6 of the adjunctive 
therapy treatment period. In this study, only 5% of patients randomized to ari¬ 
piprazole reported complaints of somnolence during the 6-week adjunctive 
therapy study period. 

To date, no studies have been reported employing PSG techniques to assess 
effects of aripiprazole on sleep physiology. In light of the importance of symp¬ 
toms of sleep disorder in patients with schizophrenia and bipolar disorder, the 
two currently established indications for aripiprazole treatment intervention, 
and the recent suggestion that aripiprazole may also be demonstrated to have 
utility as adjunctive therapy for patients with treatment-refractory MDD, it 
seems a matter of considerable importance to have data become available on 
the effects of this pharmacologically unique atypical antipsychotic drug on 
sleep physiology. 


Effects of paliperidone ER on sleep 

Paliperidone ER has become the most recently available atypical antipsychotic 
drug in the US. Paliperidone is the 9-hydroxy metabolite of risperidone [54], 
Luthringer et al. [55] recruited patients with schizophrenia who were symptom¬ 
atically stable and who also reported prominent symptoms of insomnia (>1.5 h 
of wakefulness during the night). All patients were free of other centrally acting 
drugs for at least 2 weeks prior to baseline assessment. Enrolled patients had a 
week-long period of washout of their antipsychotic drug regimen, followed by 
a 3-day baseline period and a 2-day single blind placebo run-in phase. Patients 
then participated in a 14-day double-blind, treatment period involving admin- 
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istration of paliperidone ER (9 mg) or placebo in the morning. The sleep-wake 
schedule of patents participating in this study was carefully regulated, napping 
was prohibited and caffeine consumption and smoking were tightly restricted. 
Three PSGs were carried out on consecutive nights at baseline and PSG assess¬ 
ments were repeated on days 14 and 15 of paliperidone ER or placebo adminis¬ 
tration. 

Thirty six schizophrenic patients completed the entire protocol and pro¬ 
vided suitable data for analysis. As compared to the placebo group, patients 
treated with paliperidone ER showed significant improvement in several indi¬ 
ces of sleep maintenance, including increases in TST, SE, stage 2 sleep and 
REM sleep time and decreases in SOL, time awake, number of awakenings 
and stage 1 sleep. In addition to the findings reported of marked improvement 
in several manifestations of disturbed sleep in schizophrenic patients treated 
with paliperidone ER, this study represents an important paradigm for the field 
with respect to the relatively large sample size recruited (initially 56 patients 
enrolled) and the notable attention to methodological rigor of the study design 
overall. 


Effects of switching from typical to atypical antipsychotic 
drug therapy on sleep quality in patients with schizophrenia 

Yamashita et al. [56] conducted a study examining the effects of changing from 
typical to atypical antipsychotic drugs on sleep quality in patients with schizo¬ 
phrenia. Ninety two schizophrenic patients who were being treated with a typi¬ 
cal antipsychotic drug were enrolled in this study. The mean dose of typical 
antipsychotic agents at the time of study enrollment was 1137 mg/day chlor- 
promazine equivalent units. After baseline assessments, patients were randomly 
assigned to treatment with one of four atypical antipsychotic drugs: olanzap¬ 
ine («=20, dose range, 2.5-20 mg/day, mean dose 16.5 mg/day), perospirone, an 
typical antipsychotic drug marketed in Japan («=24, dose range 4-48 mg/day, 
mean dose 37.3 mg/day), quetiapine (n=28, dose range 50-750 mg/day, mean 
dose 432.5 mg/day) and risperidone (n=20, dose range 1-12 mg/day, mean dose 
7.4 mg/day). Subjective sleep quality was assessed at baseline and at week 8 
after the switch to the randomly assigned atypical antipsychotic drug by means 
of the PSQI. Compared to ratings of sleep quality on the typical antipsychotic 
drug regimen, the switch to an atypical antipsychotic drug was associated with 
significant improvement in subjective sleep quality ratings as assessed by the 
PSQI. Individual PSQI subscores reflecting improved sleep on atypical antipsy¬ 
chotic therapy included sleep quality, sleep latency, SE and daytime dysfunc¬ 
tion. Improvement of subjective sleep quality with administration of atypical 
antipsychotic drugs was correlated with poor sleep quality at baseline, as might 
be anticipated. Additionally, improvement of subjective sleep quality was sig¬ 
nificantly correlated with improvement of negative symptoms on the positive 
and negative syndrome scale (PANSS). 
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In this chapter, we started with an overview of studies examining alterations in 
sleep physiology in patients with schizophrenia. Despite the myriad of method¬ 
ological limitations associated with the studies presented in the literature, some 
significant consistency of findings is noted, primarily characterized by abnor¬ 
malities in SOL and parameters correlated with sleep continuity such as TST, 
SE and WASO. Suggestions of alterations in REM (particularly characterized 
by shortened REM-L) and in SWS (particularly manifest by reduced amounts 
of SWS) have been reported in some studies, but these findings have been much 
less consistently replicated, perhaps related to limitations in the studies con¬ 
ducted to date, which have been associated with prominent methodological 
confounds. 

Pharmacological features of antipsychotic drugs present a strong rationale 
to anticipate that their administration would be likely to exert prominent effects 
on sleep physiology. Since antipsychotic drugs, to varying degrees, exert inhibi¬ 
tory effects at DA D 2 receptors and 5-HT 2A receptors, alterations in sleep physi¬ 
ology associated with their administration can be anticipated to be related, at 
least in part, to pharmacological effects exerted at these receptor sites resulting 
in modulation of DA and 5-HT activity. However, additional pharmacologi¬ 
cal effects produced, to varying degrees, by different antipsychotic drugs, may 
also contribute to alterations in sleep physiology associated with the antipsy¬ 
chotic drugs. Possibilities include blockade of muscarinic cholinergic recep¬ 
tors, and inhibition of a-1 adrenergic receptors and histamine H-l receptors. 
In vitro studies have documented prominent differences in binding affinities for 
these receptor sites for the various typical and atypical antipsychotic drugs [28, 
29, 31]. Thus, it is also possible that the differences observed on the basis of 
PSG studies in terms of alterations in sleep associated with administration of 
antipsychotic drugs may be attributable to these additional pharmacological 
mechanisms of action. 

In studies employing PSG techniques to characterize effects of typical and 
atypical antipsychotic drugs, some consistent findings have been reported 
across studies despite the formidable methodological problems that confound 
interpretation of results in this area. With respect to the typical antipsychotic 
drugs, a general pattern of improvement in sleep maintenance, characterized by 
increases in TST and SE and decreases in SOL and WASO have been reported 
in the majority of studies published to date (Tab. 4). 

Somewhat more variable effects have been reported for alterations in REM 
sleep and SWS as reviewed above. Studies examining effects of the various 
atypical antipsychotic drugs on sleep physiology by means of PSG techniques 
have also reported some commonalities across the class and some suggestions 
of specific differentiable effects, which may be explained on the basis of their 
differing pharmacological mechanisms of action (Tab. 5). 

In the case of clozapine, increases in TST, SE, and stage 2 sleep have most 
typically been reported, along with decreases in wake time and SWS in some 
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Table 5 Findings reported from PSG studies evaluating effects of atypical antipsychotic 
drugs on sleep. 


Atypical antipsychotic 

PSG findings 



Increased 

Decreased 

Clozapine 

TST, SE. stage 2 sleep 

WASO, SWS (some studies) 

Risperidone 

Sleep maintenance, SWS (some 
studies) 

- 

Olanzapine 

TST, SE, stage 2 sleep, REM 
density, SWS 

WASO, stage 1 sleep 

Quetiapine 

TST, SE, stage 2 sleep 

SOL, WASO, REM sleep time 

Ziprasidone 

TST, SE, stage 2 sleep, SWS, 
REM-L 

awakenings, REM%, REM 
density 

Aripiprazole 

No data available 

No data available 

Paliperidone ER 

TST, SE, stage 2 sleep, REM 
sleep time 

SOL, time awake, number 
of awakenings, stage 1 sleep 


studies. In the limited studies examining alterations in sleep associated with 
administration of risperidone, some data have been produced indicating an 
increase in sleep maintenance and, in addition, a suggestion of an increase 
in SWS has also been described. Patients with schizophrenia who have been 
studied by PSG techniques to document effects of olanzepine administration 
have been reported to show increased TST, stage 2 sleep, REM density and 
SWS and decreased wake time and stage 1 sleep. While no studies are currently 
available examining effects of quetiapine on sleep physiology in patients with 
schizophrenia or bipolar disorder, one published study has described the effects 
of quetiapine administration to healthy controls. Following administration of 
quetiapine, significant increases in TST, SE and stage 2 sleep and significant 
decreases in SOL, WASO and REM sleep time were reported. With respect to 
ziprasidone, a single study has been published to date examining effects of this 
atypical antipsychotic drug on sleep physiology in a group of healthy control 
subjects. In that study, administration of ziprasidone brought about significant 
increases in TST, SE, stage 2 sleep and SWS and significant decreases in number 
of awakenings. Ziprasidone administration was associated with some unique 
effects among the atypical antipsychotic drug class, including decreased per¬ 
centage of REM and decreased REM density as well as an increase in REM-L. 
Notably, aripiprazole has yet to have any published studies characterize its ef¬ 
fects on sleep physiology. In light of the broad use of this atypical antipsychotic 
drug in the treatment of schizophrenia and bipolar disorder, and the recent 
presentation of data suggesting its possible utility as adjunctive therapy for 
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treatment-refractory depression, it would seem a matter of considerable inter¬ 
est and pragmatic importance to have objective data become available on the 
effects of aripiprazole on sleep. Finally, a recent study by Luthringer et al. [56] 
reported on sleep modifying effects of the recently approved atypical antipsy¬ 
chotic drug paliperidone ER. In addition to documenting striking effects of 
paliperidone ER in improving measures of sleep maintenance in schizophrenic 
patients who were selected on the basis of prominent problems with insomnia, 
this study stands as an important example to the field for the rigor of its design, 
the relevance of information collected to pragmatic issues of clinical manage¬ 
ment and for the laudable attempt to minimize the presence of confounding 
methodological factors in the experimental paradigm. 

While considerable information has been reported to date on effects of 
antipsychotic drugs on sleep, there is clearly a need for much more extensive 
information on this topic. As stressed repeatedly throughout this chapter, the 
majority of studies conducted to date are limited by daunting methodological 
problems. For many of the antipsychotic drugs, there is a striking absence of 
studies carried out in the patient populations in which they are most extensively 
utilized. For example, quetiapine appears to be gaining widespread clinical us¬ 
age based in part on its perceived beneficial effects on sleep, yet no rigorous 
PSG-based studies have been conducted in patients with schizophrenia or with 
bipolar disorder. In the case of ziprasidone, a promising report on improve¬ 
ment of sleep maintenance parameters in normal control subjects has yet to 
be supplemented by studies of the effects of this atypical antipsychotic drug 
in patients with schizophrenia or bipolar disorder. Additionally, to our know¬ 
ledge, there is not a single PSG-based study available to date to characterize the 
effects of aripiprazole on sleep. In light of the tremendous importance of sleep 
problems to the clinical disorders for which the atypical antipsychotic drugs are 
employed, it seems a matter of great priority to extend significantly the base of 
solid evidence on this topic to guide investigators and for the use of clinicians 
to be able to manage sleep problems in their patients with major psychiatric 
disorders in the most rationale manner possible. 
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